Hadoop Engineer - Zazmic
CHARITY MEETUP

All you want to know about the Google Cloud Professional Certification

Learn More
Back to List

Hadoop Engineer

Our project, the world’s largest travel guidance platform, helps hundreds of millions of people each month become better travelers, from planning to booking to taking a trip. Travelers across the globe use the our site and app to discover where to stay, what to do and where to eat based on guidance from those who have been there before. With more than 1 billion reviews and opinions of nearly 8 million businesses, travelers turn to our project to find deals on accommodations, book experiences, reserve tables at delicious restaurants and discover great places nearby. As a travel guidance company available in 43 markets and 22 languages, our project makes planning easy no matter the trip type.

We are looking to staff a pod of highly skilled senior level software engineers with a passion for big data operations, a deep understanding of both software development and the *nix environment and experience with multiple technologies in the Hadoop ecosystem.

The ideal candidate will have experience with Hadoop, Hive, or MPP database platforms and experience running these environments supporting multiple internal teams.

 

Let's talk about You:

  • 4 + years experience in commercial software development
  • Ability to break down complex problems into simple solutions
  • Excellent verbal and written communication skills; Proven interpersonal skills and ability to convey key insights from complex analyses in summarized business terms; Ability to effectively communicate with technical teams
  • In-depth experience and hands-on knowledge of Linux, shell scripting, and related open source technologies such as Apache Hadoop, Kafka, Samza, and Yarn
  • Experience with Apache Hadoop ecosystem applications: Hadoop, Hive, Oozie, Presto, Hue, Spark, Zeppelin and more!
  • Strong understanding of distributed systems and distributed computation
  • Deployment automation experience with scripting, puppet, ansible, etc.

You are passionate to work with:

  • Ongoing architecture improvements in a growing startup
  • Developing new features
  • Designing and implementing architecture approaches for new infrastructure components
  • Keeping high quality of product
  • Agile values and principles

Your area of responsibility and growth:

  • Provide hands-on operational support for a high-SLA Hadoop cluster running Cloudera and participate in a pager rotation
  • Execute against pre-defined runbooks
  • Investigate and triage issues that affect our SLAs
  • Suggest improvements to prevent future disruptions Suggest and participate in preventative maintenance activities that will keep the cluster healthy and operational per our SLA requirements, such as:
  • a. Tuning in-house tools for identifying unused or un-queried data
  • b. Tuning in-house tools for managing the Small Files problem on Hadoop
  • Deploy features that will make it easier to service and operate the cluster, such as:
  • a. Using Ansible to automate taking nodes in and out of service to prevent memory leaks
  • b. With collaboration of in-house data engineering leads, help with the effort to migrate on-premises Hadoop workloads to our new cloud data platform
  • c. Port on-premises hive-SQL data workloads to supported SQL dialects and technologies: Spark-SQL, Trino, Snowflake
  • d. Migrate on-premises Spark workloads to AWS
  • e. Identify options and implement solutions for retiring old or unused data workloads

Why join us:

  • Ability to work remotely from anywhere in the world
  • Close cooperation with the development team and client
  • Opportunity to influence product development
  • Professional growth: the certification preparation course is free for our specialists. The company pays for two attempts to pass the exam, regardless of the exam result
  • We cover English classes (with a native speaker)
  • Boost professional brand: you can participate in local conferences as a listener or as a speaker
  • Regular team buildings: have fun with teammates
  • Gifts for significant life events (marriage, childbirth)
  • Tech and non-tech Zazmic Communities: support and share experience with each other

Job ID:

  • 2254976

Additional information :

  • Before submitting your CV, please pay attention to the location of the vacancy, as well as the requested skills and experience.
hr@zazmic.com

Interested? You know what to do. Apply for this position