#10439 | 2018-12-07 Malmö area, Sweden

Big Data Operations Engineer (Hadoop, Spark) (M/W)

Job Summary:
We are seeking a solid Big Data Operations Engineer focused on operations to administer/scale our multipetabyte Hadoop clusters and the related services that go with it. This role focuses primarily on provisioning, ongoing capacity planning, monitoring, management of Hadoop platform and application/middleware that run on Hadoop. (an onsite role in Malmö).

Job Description:
  • Hands on experience with managing production clusters (Hadoop, Kafka, Spark, more).
  • Strong development/automation skills. Must be very comfortable with reading and writing
Python and Java code.
  • Overall 10+ years with at least 5+ years of Hadoop experience in production, in medium to
large clusters.
  • Tools-first mindset. You build tools for yourself and others to increase efficiency and to make
hard or repetitive tasks easy and quick.
  • Experience with Configuration Management and automation.
  • Organized, focused on building, improving, resolving and delivering.
  • Good communicator in and across teams, taking the lead.
Education:
Bachelors or Master Degree in Computer Science or similar technical degree.

  • Responsible for maintaining and scaling production Hadoop, HBase, Kafka, and Spark clusters.
  • Responsible for the implementation and ongoing administration of Hadoop infrastructure including monitoring, tuning and troubleshooting.
  • Provide hardware architectural guidance, plan and estimate cluster capacity, Hadoop cluster deployment.
  • Improve scalability, service reliability, capacity, and performance.
  • Triage production issues when they occur with other operational teams.
  • Conduct ongoing maintenance across our large scale deployments.
  • Write automation code for managing large Big Data clusters
  • Work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services
  • Participate in the occasional on-call rotation supporting the infrastructure.
  • Hands on to troubleshoot incidents, formulate theories and test hypothesis, and narrow down possibilities to find the root cause.

Competence demands:
  • Hands on experience with managing production clusters (Hadoop, Kafka, Spark, more).
  • Strong development/automation skills. Must be very comfortable with reading and writing Python and Java code.
  • Overall 10+ years with at least 5+ years of Hadoop experience in production, in medium to large clusters.
  • Tools-first mindset. You build tools for yourself and others to increase efficiency and to make hard or repetitive tasks easy and quick.
  • Experience with Configuration Management and automation.


Start: as soon as found
Duration: long term assignment
Work location: Malmö area, Sweden
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Ich interessiere mich für dieses Projekt!

Datei zum Anhängen hier hineinziehen
Es wurde nichts angehängt.
Hochladen: "{{uploadingFile.name}}" Im Anhang: "{{candidate.fileName}}"
Konnte nicht bearbeitet werden "{{uploadErrFile.name}}". Es sind nur die folgenden Dateitypen zulässig: ".pdf, .doc, .docx". Bitte speichern Sie Ihre Datei in einem dieser Dateitypen ab und versuchen Sie es erneut. Datei muss kleiner sein als {{uploadErrFile.$errorParam}}
{{uploadErrorMsg}}
Anlage auswählen
{{$select.selected.commonName}}
Bitte korrigieren Sie diese Eingaben und versuchen Sie dann erneut zu senden:
  • {{ getValFieldName(field) }}

Sie haben dieses Formular soeben eingeschickt

Anmerkung: Sollten Ihre Fachkenntnisse den Anforderungen dieses Projekts entsprechen, setzen wir uns persönlich mit Ihnen in Verbindung. Ihr Beraterprofil wird selbstverständlich erst dann an den Kunden weitergeleitet, nachdem wir Rücksprache mit Ihnen gehalten haben.

Sollten Sie Fragen zu diesem Projekt haben, können Sie sich gerne an unsere Recruiting-Abteilung wenden:

Olga Saibel
Sourcing Specialist

E-Mail
Handy+46 76 843 39 34

ProData Consult uses own and third-party cookies for the purpose statistics, preferences and optimization of the website. Third parties may use cookies for targeted advertising. By accepting you give us your consent to the use of cookies. Read our Cookie Policy for more information. You can always withdraw your consent here: Impressum, Datenschutz & Cookies

The website requires the use of ‘Necessary cookies’. Our necessary cookies are only used for the purpose of deliver a proper functioning website and webservice.

Selected third parties may serve cookies on your computer or mobile device to allow relevant adverts to be delivered to you on third party websites.