Dofactory.com
Dofactory.com

Senior Spark Data Engineer

Company
Location
Atlanta, GA
Job Type
Fulltime
Level
Senior level
Skills

Job Description

Position Overview

You will work in Global Data Analytics organization that is responsible for designing, building, and maintaining cloud-based (Azure) analytics products for that directly impacts Coca-Cola’s business growth globally with an emphasis on continuous learning. Our development teams embrace agile principles to quickly generate value for our stakeholders. We have the freedom to try new ideas, experiment and are expected to be constantly learning and growing. There is also a strong emphasis on mentoring others in the group, enabling them to grow and learn.

Relocation and Work Sponsorship will not be available.

What You’ll Do for Us

  • Lead end to end design and development of the data solutions.
  • Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.
  • Develop data pipelines to ingest and transform data using Scala and SQL on Spark.
  • Setup orchestration of the pipelines using Azure Synapse pipeline.
  • Source and version control code/configuration artifacts using GitHub.
  • Create GitHub actions to deploy code/configuration artifacts.
  • Create tables/views (using SQL) in Synapse for reporting/visualization.
  • Investigate and remediate data pipeline errors or performance issues.

Qualification Requirements

  • Bachelor’s degree or higher in Computer Science or a related field.
  • 5+ years of experience in developing code on JVM (Java or Scala preferred).
  • 5+ years of Spark experience in data engineering.
  • Proficient in at least one of the programming languages like Scala, Python, and Java.
  • Knowledge of source code repository like GIT/Azure Repos build tools like Maven.
  • Familiarly with agile development practices.

Desired Qualifications

  • Deep understanding of distributed computing (Spark), cloud architecture and SQL.
  • Experience working with public clouds like Azure, AWS, Google etc.
  • Personal qualities such as creativity, tenacity, curiosity, and passion for deep technical excellence.
 
Ref #
2770514
Posted
17 days ago
  •  
Last updated 14 days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.