Search Jobs
Data Engineer - PySpark / Hadoop
|
Job Description We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering tools and technologies, including BigQuery, DataProc, GCS, PySpark, Airflow, and the Hadoop ecosystem.Key Responsibilities :- Oracle to BigQuery Migration: Lead the migration and modernization of data warehouses from Oracle to BigQuery, ensuring seamless data transfer and integration.- Data Engineering: Utilize BigQuery, DataProc, GCS, PySpark, Airflow, and Hadoop ecosystem to design, develop, and maintain scalable data pipelines and workflows.- Data Management: Ensure data integrity, accuracy, and consistency across various systems and platforms.- SQL Writing: Write and optimize complex SQL queries to extract, transform, and load data efficiently.- Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions that meet business needs.- Performance Optimization: Monitor and optimize data processing performance to ensure efficient and reliable data operations. Skills and Qualifications :- Proven experience as a Data Engineer or similar role.- Strong knowledge of Oracle to BigQuery data warehouse migration and modernization.- Proficiency in BigQuery, DataProc, GCS, PySpark, Airflow, and the Hadoop ecosystem.- In-depth knowledge of Oracle DB and PL/SQL.- Excellent SQL writing skills.- Strong analytical and problem-solving abilities.- Ability to work collaboratively with cross-functional teams.- Excellent communication and interpersonal skills.Preferred Qualifications :- Experience with other data management tools and technologies.- Knowledge of cloud-based data solutions.- Certification in data engineering or related fields. Job Classification Industry: IT Services & Consulting Functional Area / Department: Engineering - Software & QA Role Category: Software Development Role: Data Engineer Employement Type: Full time Contact Details: Company: Tetrahed Location(s): Ahmedabad .. |
Report / Flag this Job Ad
Tags :
More Jobs
Informatica IICS Powercenter / Data integration Branchville, NJ
NJ-23, Branchville, NJ, USA ESR Healthcare Informatica IICS Powerce
MySQL DBA (Database Administrator) framingham, MA (Onsite)
Framingham, MA, USA ESR Healthcare MySQL DBA (Database Administrato
EV Battery Pack Lead Engineer Foster City, CA ( Need locals)
Foster City, CA ESR Healthcare EV Battery Pack Lead Engineer Foster
Cyber Security Analyst (Alps Alpine) Detroit, MI
Detroit, MI, USA ESR Healthcare Cyber Security Analyst (Alps Alpine