Job Description: Dynamx is seeking a highly skilled and motivated Data Engineer to join our growing team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure and systems. You will collaborate with cross-functional teams to gather data requirements, develop data pipelines, and ensure data quality and reliability. Your work will directly contribute to our data-driven decision-making processes and enable us to derive valuable insights from our vast datasets.
Responsibilities:
- Design, build, and optimize data pipelines and ETL processes to efficiently extract, transform, and load large volumes of data from various sources into our data warehouse.
- Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and develop solutions that meet their needs.
- Implement data modeling techniques and best practices to ensure the scalability, efficiency, and accuracy of our data infrastructure.
- Identify and address data quality issues, including data cleansing, data transformation, and data validation.
- Monitor and optimize data processing and storage systems to ensure high performance and reliability.
- Stay updated with the latest technologies and trends in the field of data engineering and recommend improvements to enhance our data infrastructure.
- Collaborate with the IT team to ensure the security and privacy of our data systems, complying with industry standards and regulations.
- Document data processes, workflows, and data dictionaries to maintain a clear understanding of the data architecture and facilitate knowledge sharing among team members.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field. Master’s degree is a plus.
- Proven work experience as a Data Engineer or in a similar role, handling large-scale data projects and designing data infrastructure.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience with data integration tools and technologies, such as Apache Kafka, Apache Nifi, or similar.
- Proficiency in SQL and database systems (e.g., PostgreSQL, MySQL, or similar) with expertise in writing efficient queries and optimizing data retrieval.
- Familiarity with cloud-based data platforms and services, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).
- Experience with big data technologies, such as Hadoop, Spark, or similar frameworks.
- Solid understanding of data modeling concepts and techniques, including dimensional modeling and schema design.
- Strong problem-solving skills and attention to detail, with the ability to analyze complex data sets and derive actionable insights.
- Excellent communication and collaboration skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.
Preferred Qualifications:
- Advanced degree in a relevant field, such as Data Science, Data Engineering, or Analytics.
- Experience with machine learning frameworks and algorithms.
- Knowledge of data governance principles and data privacy regulations (e.g., GDPR, CCPA).
- Familiarity with containerization technologies, such as Docker or Kubernetes.
Join our team of talented professionals and make a significant impact on our data-driven initiatives. If you have a passion for data engineering, a keen eye for detail, and enjoy working in a dynamic and collaborative environment, we would love to hear from you.
To apply, please submit your resume, cover letter, and any relevant portfolio or code samples here