Dofactory.com
Dofactory.com

Data Engineer-Houston, TX

Location
Houston, TX
--
Remote
Pay
$130,000 - $135,000 / Year 
--
Fulltime
Level
Senior level
Skills

Job Description

Data Engineer: remote in Texas

Must be a permanent US Resident to be considered. No Contract, C2C or 3rd parties.

This is a permanent position for a Data Engineer with client’s retail energy client in Texas. You must live in Texas and can work remote in Texas but must be able to travel to Houston for occasional office visits.

Description:

Our client is looking for a savvy Data Engineer to join their growing team of data platform experts. The hire will be responsible for expanding and optimizing client’s data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

The Data Engineer will support their software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing company’s data architecture to support the next generation of products and data initiatives.

Reporting into the Data Platform Manager, the role requires self-motivated, dedicated and responsible individual with the ability to perform well under pressure.

Responsibilities:

Ø Create and maintain optimal data pipeline architecture.

Ø Assemble large, complex data sets that meet functional / non-functional business requirements.

Ø Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Ø Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ‘big data’ technologies and tools.

Ø Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Ø Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Ø Keep client’s data separated and secure across national boundaries through multiple data centers and availability regions.

Ø Create data tools for analytics and data scientist team members that assist them in building and optimizing client’s product into an innovative industry leader.

Ø Work with data and analytics experts to strive for greater functionality in client’s data systems.

Requirements:

Ø Bachelor’s Degree or higher and 5+ years of experience in a related role.

Ø Must live in Texas with the ability to attend occasional office visits in Houston

Ø 5+ years of experience in a Data Engineer role.

Ø Experience with data tools: Dremio (primary), Databricks, Spark, etc.

Ø Experience with relational SQL and NoSQL databases, including MSSQL, Postgres, MongoDB, TimescaleDB, etc.

Ø Experience with data pipeline and workflow management tools: Airflow (primary), Kubeflow, Azkaban, Luigi, etc.

Ø Experience and competency in AWS services: EC2, S3, EFS, EMR, RDS, etc.

Ø Familiarity with data warehouse technologies: RedShift, SQL DW, Snowflake

Ø Experience with stream-processing systems: Kafka (primary), Spark-Streaming, Change Data Capture, etc.

Ø Experience with object-oriented/object function scripting languages: Python (primary), Golang, Java, C++, Scala, etc.

Ø Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

Ø Experience building and optimizing data pipelines and curated data queries.

Ø Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Ø Build processes supporting data transformation, data structures, metadata, dependency and workload management.

Ø A successful history of manipulating, processing and extracting value from large, disconnected datasets.

Ø Working knowledge of message queuing, stream processing, and data lakes.

Ø Be a proactive team player - They are small team with big ambitions in doing things at speed. As they work across a number of channels, projects, and conflicting priorities, being able to navigate and juggle multiple things on the go is required as well as being proactive enough to anticipate the next steps and actions.

Ø Good communication skills, written and oral, for example ensuring sales agents are kept informed of any delays in turning around pricing requests, or outlining the rationale behind a decision not to approve credit for a customer.

Ø Analytical mindset, demonstrate ability to problem solve and create practical solutions to overcome problems and mitigate risks.

Ø Comfortable working in a target-driven and fast-changing environment, and able to respond to changing business needs

Ø Excellent attention to detail

Ø Proficient use of Microsoft Office programs including Word, Outlook and strong Excel skills

Ø Excellent analytical, organization and time management skills, with the ability to maintain a strict level of attention to detail

Ø Ability to work well within a team environment and demonstrate a vested interest in team goals and objectives

Ø Excellent interpersonal, verbal and written communication skills, with the ability to establish and maintain positive and effective working relationships

Ø Self-motivated with the desire to consistently improve performance and gain further knowledge

Ø Ability to meet deadlines, learn quickly and demonstrate effective problem solving and follow-up skill

$130-$135k base plus bonus potential, benefits, vacation, 401(k), and remote in Texas! Please include resume plus annual salary requirements.

Job Type: Full-time

Pay: $130,000.00 - $135,000.00 per year

Benefits:

  • 401(k)
  • 401(k) matching
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Paid time off
  • Tuition reimbursement
  • Vision insurance

Compensation package:

  • Bonus opportunities

Experience level:

  • 5 years

Schedule:

  • Monday to Friday

Education:

  • Bachelor's (Required)

Experience:

  • Data Engineer: 5 years (Required)
  • SQL: 5 years (Required)
  • AWS: 3 years (Required)
  • Python: 5 years (Required)

Ability to Commute:

  • Houston, TX (Required)

Work Location: In person

 
Ref #
2767550
Posted
30+ days ago
  •  
Last updated 28 days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.