Dofactory.com
Dofactory.com

Data Engineer

Company
Location
United States
Pay
$85,000 - $115,000 / Year 
--
Fulltime
Level
Senior level
Skills

Job Description

Description:

General Job Summary

As a Data Engineer, you will play a vital role in designing, developing, and optimizing our data architecture to meet evolving business needs. You will collaborate closely with our technology and business stakeholders to implement solutions using the full potential of cloud-based technologies. We are looking for someone who can design, code and execute in both cloud and on-prem environments. The ideal candidate will have a solid foundation in data engineering, cloud technologies, a willingness to learn and a passion for leveraging cloud-based technologies.

Summary of Essential Job Functions

  • Azure Data Services: Leverage a range of Azure data services, such as Azure Data Lake Storage, Azure Synapse Analytics, Azure Databricks, Azure Data Factory, Azure SQL Database, and others, to build scalable and robust data solutions.
  • Data Integration: Develop efficient data integration processes using Azure Data Factory, SSIS, and other relevant tools to extract, transform, and load data from various sources into the data platform.
  • Data Modeling: Design logical and physical data models, ensuring data integrity, performance, and optimal storage solutions.
  • Data Security: Work closely with team to implement data security measures and access controls to ensure data privacy and compliance with industry regulations and company policies.
  • Performance Optimization: Continuously monitor and fine-tune the data platform for maximum performance and reliability.
  • Data Governance: Establish data governance practices, data quality standards, and data lineage to ensure data accuracy and consistency.
  • ETL Automation: Automate ETL workflows, data pipelines, and other processes to improve efficiency and reduce manual intervention.
  • Emerging Technologies: Stay updated with the latest trends and advancements in cloud-based data technologies and propose innovative solutions to enhance the data platform.
  • Maintaining Standards and Best Practices: Adhere to data engineering standards, best practices, and coding guidelines to ensure consistency, quality, and maintainability of data solutions.
  • Documentation: Document legacy and new data processes, data flows, data architecture, and data platform components to facilitate knowledge sharing and enable seamless collaboration among team members.
  • Operational Support: Provide operational support for the Azure data platform, including monitoring, incident resolution, and troubleshooting to ensure the platform's stability, availability, and reliability.
  • Projects: Contribute to delivery of multiple projects simultaneously. Work on other projects as assigned.
  • Operational Support: Provide operational support for the Azure data platform, including monitoring, incident resolution, and troubleshooting to ensure the platform's stability, availability, and reliability.
  • Participation in an on-call rotation to provide support during non-business hours is a requirement for this position.
  • Performs related duties as assigned.

Core Development Stack

  • Languages: SQL (standard and DB-specific).
  • Tools Products: Microsoft Azure Cloud Services (Azure Data Lake Storage, Azure Synapse Analytics, Azure Databricks, Azure Data Factory, Azure SQL Database, Azure Cosmos DB etc.), SQL Server, SSIS (SQL Server Integration Services), SSRS (SQL Server Reporting Servicing), Microsoft PowerBI, RedGate Developer Toolkit, RedGate SQL Monitor.
  • Frameworks: Agile Development Methodologies.
  • Other: Azure DevOps, Jira, Confluence, LucidChart, Smartsheet.
Requirements:

Education, Training and Work Experience

  • College or university degree in the field of Information Technology, Data Science, Computer Science, MIS, or another STEM-related field required.
  • Significant experience in a similar role or industry will be considered as a replacement.
  • 3+ years of relevant experience in data engineering.
  • 2+ years of experience in mortgage servicing or mortgage lending.

Knowledge, Skills, and Abilities

  • Experience in data and analytics technologies, RDBMS, ETL, ELT and BI.
  • Hands-on experience with Azure Data Services, SQL Server, and SSIS.
  • Experience in programming languages like Python, Scala, or C# for data processing and automation.
  • In-depth knowledge of data modeling concepts and data warehousing principles.
  • Understanding of data security, data governance, and data compliance practices.
  • Excellent problem-solving skills with the ability to design scalable and efficient data solutions.
  • Demonstrated experience in performance tuning and optimization of data systems.
  • Understanding of agile development methodologies and version control systems.
  • Strong communication and interpersonal skills to collaborate effectively with cross-functional teams and stakeholders.
  • Experience with AWS, GCP, Snowflake and other cloud technologies is a plus.
  • Experience in other languages such as R, Spark SQL, Java, etc. is a plus.
  • Experience in solution design spanning multiple frameworks.
  • Familiarity with API-first architectures.
  • Knowledge of real time streaming data delivery and batch processing.

Working Environment

Primary working environment is within an indoor climate-controlled office space and/or a private home office or some combination which will be at managements sole discretion. Employee may be subject to florescent lighting, dust, and other normal indoor allergens. Employee may work in close proximity of coworkers and occasionally independently in quiet environments.

Physical Requirements

  • Able to lift up to 20 pounds.
  • May be exposed to extended periods of interaction with others (listening/talking/taking notes).
  • Extended periods of sitting (at computer desk).
  • Complete repetitive tasks (including operation of computer mouse/keyboard).

Disclaimer

The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not to be construed as an exhaustive list of all responsibilities, duties, and skills required of personnel so classified. All personnel may be required to perform duties outside of their normal responsibilities from time to time, as needed.

The salary range for this role ($85,000 -$115,000/year) takes into consideration a wide range of factors including but not limited to the duties of the role, experience, location, and certificates and/or education.

**University Bank is an Equal Opportunity / Affirmative Action Employer**

 
Ref #
2759078
Posted
30+ days ago
  •  
Last updated 30+ days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.