ETL SDET - PySpark Coding Experience Job at Cloud Analytics Technologies LLC, Jersey City, NJ

aTlvdC9VWmFuTkVWd29GblNXMllDTkdnZVE9PQ==
  • Cloud Analytics Technologies LLC
  • Jersey City, NJ

Job Description

Job Details

Must-Have Skills:

  • ETL Testing, Python PySpark - Coding Experience is Mandatory
  • AWS S3, Redshift
  • Complex SQL Quires - Wring Complex Query is Mandatory

Good to Have:

  • Kafka, Shell scripting, Healthcare domain

Position Summary:

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.

This role involves designing and implementing automated tests to validate data transformation and migration,

as well as collaborating with data engineers and developers to identify and resolve data quality issues.

The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification:

  • At least 12 years of IT experience with minimum 8 years of experience in below skills:
  • Tech Skills
    • Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
    • Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
    • Testing experience in cloud environment (AWS s3)
    • Experience with Test Automation and DevOps practices in ETL and Cloud
    • Work experience in a Big Data ecosystem processing data in data lakehouse.
    • Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
  • Experience providing testing oversight in Agile team.
  • Should have excellent business communication to interact with Business teams and cross-functional teams.

Job Tags

Work experience placement,

Similar Jobs

NTT DATA, Inc.

Senior IBM DataStage Developer - ONSITE Job at NTT DATA, Inc.

 ...If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior IBM DataStage Developer - ONSITE to join our team in Mahwah, New Jersey (US-NJ), United States (US). Senior IBM DataStage Developer... 

MUSC Health

UNIV - Part-Time Doula - Psychiatry: Women's Reproductive Behavioral Health Job at MUSC Health

 ...worker to provide peer support and recovery-focused prenatal, labor and postpartum support for perinatal women and their babies. This...  ...provide hospital-based support to patients presenting for delivery at Shawn Jenkins Childrens Hospital, participating as an (non-... 

Schlumberger

Manufacturing Welder Job at Schlumberger

Operate hand and power tools common to the welding trade. High school Diploma or GED. At least 2-3 years of relevant experience. Associate Degree in welding (or equivalent).

Naviga

Talent Acquisition Recruiter (Agency Recruitment Experience Required) Job at Naviga

 ...professionals with organizations looking to achieve exceptional results. The Opportunity We are seeking a dynamic, results-focused Talent Acquisition Recruiter to join our internal team. This is a unique opportunity to own the full recruiting lifecycle, manage key... 

Funovus

2D Artist Job at Funovus

 ...Funovus is a game development studio based in the United States with team members around the globe. Together we've embraced a remote...  ...rendering ability. Mobile game developing experience. Familiar with 2D Animation or VFX experience, like Spine, AE, Flash, etc....