Dofactory.com
Dofactory.com

Azure Data Engineer

Company
The Data Element
Job Type
Fulltime
Level
Mid level
Skills

Job Description

Overview
We are seeking a talented and motivated Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will work closely with cross-functional teams to ensure the availability, reliability, and performance of our data systems.

This is a long term contract position. No H1B sponsorship.

  • Responsibilities:
  • Design, develop, and implement data pipelines using Azure Data Factory to ingest, transform, and integrate data from various sources.
  • Implement data integration solutions that meet business requirements and ensure data quality and reliability.
  • Synapse Analytics: Work with Azure Synapse Analytics to design and implement data warehousing solutions.Develop and optimize Synapse SQL Pool (formerly known as SQL Data Warehouse) for efficient querying and reporting.
  • Synapse Pipelines :Create and manage Synapse Pipelines to orchestrate end-to-end data workflows.Monitor and optimize pipeline performance to ensure timely and reliable data processing.
  • Synapse Spark:Leverage Azure Synapse Spark for big data processing and analytics.Develop and optimize Spark jobs to handle large-scale data processing requirements.Data Modeling:Design and implement data models to support analytical and reporting requirements.Ensure data models are scalable, performant, and aligned with business needs.
  • Collaboration:Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.
  • Documentation:Create and maintain comprehensive documentation for data engineering solutions, including design documents, process flow diagrams, and operational guidelines.
  • Performance Tuning:
  • Qualifications:
  • Data Ingestion and Integration:
  • Identify and address performance bottlenecks in data pipelines, SQL queries, and Spark jobs.
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 3-5 years of hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Synapse Pipelines, Synapse Spark, and Synapse SQL Pool.
  • Proficient in SQL and T-SQL.
  • Strong understanding of data warehousing concepts and best practices.
  • Experience with big data technologies and frameworks.
  • Excellent problem-solving and analytical skills.
  • Effective communication and collaboration skills.
  • Microsoft Azure certifications (e.g., DP-200, DP-201, DP-203) are a plus.

If you are a passionate Data Engineer looking for an opportunity to work on cutting-edge projects in a collaborative environment, we would love to hear from you. Apply now!

Job Type: Full-time

Experience level:

  • 3 years

Schedule:

  • Monday to Friday

Work Location: Remote

 
Ref #
2767525
Posted
18 days ago
  •  
Last updated 18 days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.