Data Engineer

Title: Data Engineer

Location: Remote

Responsibilities:

Design, develop, and maintain scalable data pipelines.

Implement data integration solutions to consolidate data from various sources.

Optimize and manage data storage solutions, including databases and data warehouses.

Ensure data quality and integrity through rigorous testing and validation.

Collaborate with data scientists and analysts to support their data needs.

Monitor and troubleshoot data pipeline issues to ensure smooth operation.

Document data processes and workflows for future reference.

:

Bachelor’s degree in Computer Science, Information Technology, or a related field.

3+ years of experience in data engineering or a similar role.

Proficiency in SQL and experience with database management systems (e.g., MySQL, PostgreSQL).

Experience with big data technologies (e.g., Hadoop, Spark).

Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud).

Strong programming skills in languages such as Python, Java, or Scala.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration abilities.

Skills:

Spark/Scala: 2 years

MongoDB: 2 years

PostgreSQL or any relational database experience: 2 years

AWS services (Lambda, SNS, S3, Batch Jobs, Step Functions, EC2, ECR, etc.): 2 years

Apache Kafka: 2 years

Java: 5 years

Git (GitLab preferred)

Experience working in an Agile framework/team

Job Type: Full-time

Pay: $50.46 - $65.72 per hour

Experience:

• Informatica: 1 year (Preferred)
• SQL: 1 year (Preferred)
• Data warehouse: 1 year (Preferred)

Work Location: Remote