Skip to content
Go to homepage

site

  • About
  • Our Team
  • Job Openings
  • Contact

This site uses cookies to improve the user experience! Would you like to allow cookies?

Cookie Settings

These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.

These cookies help us understand and improve the use and performance of our services including what links visitors clicked on the most, and how they interact with the various areas and features on our website and apps.

Data Engineer

Job #: 26-02929
Pay Rate: Not Specified
Job type: contractor
Location: San Jose, CA
Apply Now Back to Search
Lead the end-to-end migration (transformation and load) of high-volume, high-complexity data into a new PostgreSQL-based infrastructure
Design, build, and maintain robust ETL/ELT pipelines capable of processing millions of records reliably and efficiently
Map and reconcile complex legacy data structures across multiple business entities into a unified target schema
Define and implement data validation frameworks to ensure integrity, completeness, and accuracy throughout the migration
Optimize pipeline performance, including query tuning, indexing strategy, and batch/incremental load design in PostgreSQL
Identify, troubleshoot, and resolve data quality issues, schema mismatches, and pipeline failures
Document data mappings, transformation logic, and migration runbooks for engineering and business stakeholders
Partner with business and technical stakeholders to align migration scope, timelines, and data requirements
Establish monitoring, logging, and alerting to track pipeline health and data quality post-migration
Mentor junior data engineers and contribute to engineering best practices and standards

Required Qualifications

5+ years of experience in data engineering, with demonstrated ownership of large-scale data migration projects
Strong to expert-level proficiency in Python for building and automating data pipelines
Deep hands-on experience with PostgreSQL/Oracle , including schema design, query optimization, and performance tuning
Proven experience designing and managing ETL/ELT pipelines at scale (millions of records)
Experience mapping and transforming complex, legacy data structures across disparate systems or business entities
Strong understanding of data validation, reconciliation, and quality assurance techniques
Solid grasp of data modeling principles (normalization, indexing, partitioning)
Experience with version control (Git) and CI/CD practices for data pipelines
Preferred Qualifications
Experience with orchestration tools (e.g., Airflow, Dagster, Prefect)
Familiarity with cloud data platforms (AWS, GCP, or Azure)
Experience with other relational or NoSQL databases and cross-database migrations
Background working in regulated or high-stakes data environments (finance, healthcare, etc.)
Experience with containerization (Docker) and infrastructure-as-code
Exposure to data quality/testing frameworks (e.g., Great Expectations, dbt tests)
What Success Looks Like
A fully migrated, validated dataset in PostgreSQL with zero critical data loss or corruption
ETL/ELT pipelines that are documented, repeatable, and optimized for ongoing operation
A clear audit trail of data lineage and validation results across all business entities involved
Apply Now Back to Search
Go to corporate home page
Copyright © 2026 TechDigital Group
  • linkedin
  • facebook
Monster Strategic Talent Solutions