Data Engineer (Spark ,Scala, Elastic Search) xpatjobs Manila , Metro Manila
External Job Aggregation > Data Engineer (Spark ,Scala, Elastic Search)

Search Jobs

Search

Data Engineer (Spark ,Scala, Elastic Search)


xpatjobs       |    Location:Manila , Metro Manila       |    Country:Philippines

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions Implement data transformations, aggregations, and computations using Spark RDDs, DataFrames, and Datasets, and integrate them with Elasticsearch Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration Requirements 5+ Years as Data Engineer 5 Years experience in Spark, Scala, Elastic Search Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components Stay updated with emerging trends and advancements in the big data technologies space to ensure continuous improvement and innovation

Similar Jobs




Report / Flag this Job Ad


Tags :
Data   Engineer   (Spark   ,Scala,   Elastic   Search)   Data Manila , Metro Manila   Engineer Manila , Metro Manila   (Spark Manila , Metro Manila   ,Scala, Manila , Metro Manila   Elastic Manila , Metro Manila   Search) Manila , Metro Manila  

More Jobs

Outbound Sales Representative

Great culture, great environment. Where you get to be your best!!! Exclusively represent global n

  • Ability to quickly articulate technical and business value propositions via phone, email and chat
  • Ability to effectively navigate through multiple web applications and multiple web chat sessions simultaneously in a prompt, friendly and professional manner
  • Achieve established sales goals and objectives
  • Ability to learn quickly and maintain a current, comprehensive knowledge of client''s products and services
  • Proficiency with Microsoft Office and relevant computer software and hardware
  • Excellent verbal and written communication skills, including outstanding telephone presence
  • Koreanspeaking candidates will be highly regarded!
    • About the Offer;
    • Full time contract - Monday to Friday
    • Competitive market base rate + super + great commission!
    • Convenient Knox City Ozone location, with access to Westfield Centre - staff discounts
    • Fully paid training and ongoing development
    • Opportunities to move into other areas within the business both in Australia and globally
    • Access to our corporate partnerships (gas/electricity, private health, travel, etc.)
    • An incredibly fun, social and energetic culture
    • An environment promoting health well being
    • Friday afternoon social gatherings every week!
    If this role sounds likeYOUthen please applyNOW
    '>

    Waiter or Waitress

    Wehave positions forreliable experienced Waiter or Waitress We are able to give regular casual shi

    Bricklayer wanted

    Looking for a bricklayer to start full time. Must have ABN White card and car. All work is in Poi

    Front of House/ Catering delivery driver

    We are looking for an experienced catering delivery driver to join our team, Monday-Friday for our

    Duties will include: Maintaining front of house, clearing tables, replenishing fridges and delivery of catering.

    Applicant should be fluent in English, an Australian Citizen, well groomed, reliable and hard working.

    Please email your resume to Hilda

    '>