Dofactory.com
Dofactory.com

8+Yrs in Azure Data Engineer - Remote

Company
Padmastech
Pay
$65 - $70 / Hour 
--
Contract
Level
Mid level
Skills

Job Description

Role : Azure Data Engineer

Location :Remote

Roles Responsibilities:

Job descriptions:

We operate in an Azure + Databricks Lakehouse. We’ll need a person with:

* Azure experience – ADF for orchestration, ADLS for storage, AzureDevOps for CI/CD

* Databricks experience – all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL)

* PowerShell experience – this is our scripting language of choice

* SQL proficiency – it’s used everywhere (TSQL, PostgreSQL)

* Proficiency with parquet and delta formats

Additionally – they will need experience in:

* SDLC + CI/CD – we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.

* Should have a deep understanding of indexes and partitioning.

* Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)

* Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)

Job Type: Contract

Pay: $65.00 - $70.00 per hour

Schedule:

  • 8 hour shift

Experience:

  • SDLC + CI/CD: 5 years (Preferred)
  • ADF for orchestration, ADLS for storage, AzureDevOps: 5 years (Preferred)
  • computeleverages Databricks is programmed leveraging Spark: 5 years (Preferred)
  • PowerShell: 5 years (Preferred)
  • SQL proficiency: 5 years (Preferred)
  • Proficiency with parquet and delta formats: 5 years (Preferred)

Work Location: Remote

 
Ref #
2770492
Posted
17 days ago
  •  
Last updated 14 days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.