Data Scientist and Data Engineer

Bachelor of Technology/Engineering (Computers)

Nationality: Any Nationality

Vacancy: 1 Vacancy

Job Description

Key Responsibilities:

• Write and tune complex Java, MapReduce, and Hive jobs.
• Lead a Backend/Distributed Data Systems team while remaining hands-on.
• Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develop top-quality dashboards using industry best practices.
• Manage a team of data engineers (both full-time associates and/or third-party resources).
• Analyze and confirm the integrity of source data to be evaluated.
• Lead in deployment and auditing models and attributes for accuracy.
• Experience with stream-processing systems: Spark-Streaming, Storm, etc.
• Experience with object-oriented/object function scripting languages: Python, Scala, etc.
• Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data.
• Proficient in writing Advanced SQLs, expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Financial Services knowledge is a plus.
• Build and maintain cooperative work relationships with others.

Requirements

As a Data Scientist and Data Engineer, you should have:

• Extensive experience in the Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase, etc.) across Fractal and contribute to open-source Big Data technologies.
• Python/Spark based Data Engineer and Data Scientist experience.
• Previous experience of 7-10+ years as a big data engineer.
• In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
• Experience with Azure cloud services is a plus.
• Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
• Own most deliverables for the Big Data team from a delivery perspective.
• Ability to solve complex networking, data, and software issues.
• Able to effectively plan & organize their work.
• Strong interpersonal communication skills.
• Assist others in the completion of their tasks to support group goals.