Dofactory.com
Dofactory.com

Cloud Data Engineer

Company
Mindcracker
Pay
$60 - $65 / Hour 
--
Fulltime, Contract
Level
Senior level
Skills

Job Description

Mindcracker is looking for a motivated Cloud Data Engineer who will work within a team consisting of a core group of software developers, designers, and product managers who develop software products, dashboards, and reports to help our public agency clients better screen and observe credentials. This opportunity is for a fully remote (US only) software development engineer role.

What you will be doing:

  • Designing and Developing ETL Processes in AWS Glue to migrate data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
  • Building processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Providing resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface.
  • In charge of troubleshooting problems across infrastructure, platform, and application domains as they arise throughout the lifecycle and development.

What you need to be successful in this role:

  • 8+ yrs. of experience in IT and working as a Data Architect and 7+ years in Data warehouse, ETL, BI Projects.
  • Must have expertise in AWS and Azure Platform as a Service (PAAS).
  • Must have experience of Agile development methodologies.
  • Must have experience at least 4 End to End implementations of cloud data warehouse (Redshift, Postgres, or Snowflake).
  • Hands-on experience with Postgres SQL, RedShift, Redshift spectrum, AWS Glue, Athena, Snowflake utilities, Snow SQL, Snow Pipe, AWS Lambda model techniques using Python.
  • Experience in Data Migration from RDBMS to Redshift/Snowflake cloud data warehouse.
  • Expertise in data modeling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL/ELT concepts.
  • Expertise in advanced concepts like setting up resource monitors, Role-based access controls (RBAC), virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understanding how to use these features.
  • Expertise in deploying features such as data sharing, events, and lake-house patterns.
  • Deep understanding of relational as well as NoSQL data stores, Methods, and approaches (Star and Snowflake, Dimensional Modeling).
  • Experience with data security and data access controls and design.
  • Experience with AWS or Azure data storage and management technologies such as S3 and ADLS.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot.
  • Strong written communication skills. Is effective and persuasive in both written and oral communication.

Job Types: Full-time, Contract

Pay: $60.00 - $65.00 per hour

Schedule:

  • 8 hour shift

Work Location: Remote

 
Ref #
2770506
Posted
26 days ago
  •  
Last updated 22 days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.