Post to Multiple Job Boards

Now take benefits of multiple job boards and search engine posting.
Try it.

Job Senior Big Data Developer South Australia Big Data

Senior Big Data Developer

Skills:Big Data       |  Location:South Australia  ,  Australia


Position: Senior Big Data Developer

Position Description:

We are looking for a Big Data Engineer that will work on the collecting,
storing, processing, and analyzing of huge sets of data. The primary focus will
be on choosing optimal solutions to use for these purposes, then maintaining,
implementing, and monitoring them. You will also be responsible for integrating
them with the architecture used across the company.


    Selecting and integrating any Big Data tools and frameworks required to
provide requested capabilities
    Implementing ETL process
    Monitoring performance and advising any necessary infrastructure changes
    Defining data retention policies

Skills and Qualifications:

    Proficient understanding of distributed computing principles
    Management of Hadoop cluster, with all included services
    Experience Coding with Java, Python or Scala is required
    Ability to solve any ongoing issues with operating the cluster
    Proficiency with Hadoop v2, MapReduce, HDFS
    Experience with building stream-processing systems, using solutions such
as Storm or Spark-Streaming
    Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
    Experience with Spark
    Experience with integration of data from multiple data sources
    Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
    Knowledge of various ETL techniques and frameworks, such as Flume
    Experience with various messaging systems, such as Kafka or RabbitMQ
    Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
{{if you are going to integrate Machine Learning in your Big Data
    Good understanding of Lambda Architecture, along with its advantages and
    Experience with Cloudera/MapR/Hortonworks

Email @

Save me for future

Check Similar Jobs

Create Job Alerts

Recent Gigs

Design and deploy your website to Digital Ocean-($299)
Design and deploy your website to Digital Ocean.
Not rated
Design and deploy your website to AWS.-($399)
Design and deploy your website to AWS.

About Me .
Not rated
Migrate your current website to AWS-($99)
Migrate your current website to AWS
About Me : I am a .
Not rated
1 article for your business-($2)
I will write 500 words article for your business/blog
Not rated
15+ private blog network links-($2)
I will promote your website with links from private network .
Not rated

Recent Projects

TV Aerials Sheffield-($1000-$50000)
Experienced TV Aerial Engineer Needs For Sheffield Area Shef
Independent Fright Dispatcher Looking For Owner operators-($0-$0)
If you need a Reliable Dispatch Service that will find YOU t
Personal Assistant-($500-$1000)
As a personal assistant (PA) you will work closely with seni
Freelance assistant-($100-$500)
hi, I need a freelance assistant for various tasks. It inclu
Freelance Website Developer -($1000-$2000)

This role is perfectly suited to a recent graduate loo