Pyspark developer IndigoJobs Multi-City, India
External Job Aggregation > Pyspark developer

Search Jobs

Search

Pyspark developer


IndigoJobs       |    Location:Multi-City, India       |    Country:India

Job Description

:

We are seeking a highly skilled Big Data Engineer with expertise in PySpark to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure, as well as optimizing data processing pipelines. The ideal candidate will have a strong background in Python, PySpark, and big data technologies, along with experience in building scalable and efficient data pipelines.

Responsibilities:

  1. Designing, implementing, and maintaining big data pipelines using PySpark.
  2. Developing and optimizing ETL processes to ingest, process, and transform large volumes of data.
  3. Collaborating with data scientists and analysts to understand their requirements and translate them into technical solutions.
  4. Performance tuning of Spark jobs to improve efficiency and reduce processing time.
  5. Troubleshooting and debugging issues in data pipelines and Spark applications.
  6. Working with cross-functional teams to integrate new data sources and ensure data quality and integrity.
  7. Implementing monitoring and alerting solutions to ensure the reliability and availability of data pipelines.
  8. Staying up-to-date with the latest advancements in big data technologies and recommending improvements to existing systems.

Employement Category:

Employement Type: Full time
Industry: IT Services & Consulting
Role Category: General / Other Software
Functional Area: Not Applicable
Role/Responsibilies: Pyspark developer

Similar Jobs




Report / Flag this Job Ad


Tags :
Pyspark   developer   Pyspark Multi-City, India   developer Multi-City, India  

More Jobs

Outbound Sales Representative

Great culture, great environment. Where you get to be your best!!! Exclusively represent global n

  • Ability to quickly articulate technical and business value propositions via phone, email and chat
  • Ability to effectively navigate through multiple web applications and multiple web chat sessions simultaneously in a prompt, friendly and professional manner
  • Achieve established sales goals and objectives
  • Ability to learn quickly and maintain a current, comprehensive knowledge of client''s products and services
  • Proficiency with Microsoft Office and relevant computer software and hardware
  • Excellent verbal and written communication skills, including outstanding telephone presence
  • Koreanspeaking candidates will be highly regarded!
    • About the Offer;
    • Full time contract - Monday to Friday
    • Competitive market base rate + super + great commission!
    • Convenient Knox City Ozone location, with access to Westfield Centre - staff discounts
    • Fully paid training and ongoing development
    • Opportunities to move into other areas within the business both in Australia and globally
    • Access to our corporate partnerships (gas/electricity, private health, travel, etc.)
    • An incredibly fun, social and energetic culture
    • An environment promoting health well being
    • Friday afternoon social gatherings every week!
    If this role sounds likeYOUthen please applyNOW
    '>

    Waiter or Waitress

    Wehave positions forreliable experienced Waiter or Waitress We are able to give regular casual shi

    Bricklayer wanted

    Looking for a bricklayer to start full time. Must have ABN White card and car. All work is in Poi

    Front of House/ Catering delivery driver

    We are looking for an experienced catering delivery driver to join our team, Monday-Friday for our

    Duties will include: Maintaining front of house, clearing tables, replenishing fridges and delivery of catering.

    Applicant should be fluent in English, an Australian Citizen, well groomed, reliable and hard working.

    Please email your resume to Hilda

    '>