Dofactory.com
Dofactory.com

Azure Data Factory Engineer

Location
Irving, TX
Job Type
Fulltime
Level
Senior level
Skills

Job Description

Senior ADF Engineer

Irving TX

Full Time

Summary
We are seeking a highly skilled and experienced Senior ADF Engineer/Architect to join our team and play a key role in developing and maintaining our Azure Data Factory (ADF) pipelines. The ideal candidate will have a strong understanding of Microsoft Fabric/ETL concepts and experience in designing, implementing, and monitoring ADF pipelines for data integration and transformation.

Responsibilities.

  • Design, develop, and maintain ADF pipelines for ingesting, transforming, and loading data from various sources into Azure Data Lake Storage (ADLS) and other data destinations.
  • Utilize ADF's built-in connectors and activities to perform data extraction, transformation, and loading (ETL) operations.
  • Implement data cleansing, transformation, and filtering logic within ADF pipelines.
  • Develop and maintain documentation for ADF pipelines, including design documents, user guides, and code comments.
  • Monitor and troubleshoot ADF pipelines to ensure efficient and reliable data processing.
  • Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and design effective data solutions.
  • Stay up-to-date with the latest advancements in ADF and related Azure data services.
  • Should have done end to end implementation of data platform development and delivery in offshore and nearshore development teams.
  • Should have a good understanding of all the concepts of data lake, data Lakehouse and modern data platform build.

 
Qualifications

  • Proven experience as a Senior ADF Engineer or similar role for 7-15 years
  • In-depth knowledge of Azure Data Factory (ADF) concepts, functionalities, and best practices.
  • Solid understanding of Microsoft Fabric/ETL principles and practices.
  • Experience with data integration and transformation techniques, including data cleansing, transformation, and filtering.
  • Experience with SQL and other scripting languages (e.g., Python, Windows Shell Script) for data manipulation.
  • Familiarity with cloud computing concepts and experience working with Azure cloud services is a plus.
  • Excellent communication, collaboration, and problem-solving skills.
  • Strong attention to detail and a commitment to delivering high-quality work.

 

 
Ref #
2768700
Posted
30+ days ago
  •  
Last updated 30+ days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.