Kafka Platform Engineer

About the team:
As the Sr. Kafka Platform Engineer, you will be expected to build & run a distributed, scalable & robust data streaming platform. This includes provisioning services, tooling, and environments for MMD’s suite of data platforms consisting of messaging, integration and distribution platforms.
The primary responsibility of the role will include the setup, configuration, administration, and operations of the Confluent Kafka Platform. This role also includes developing and optimizing DevOps pipelines for CI/CD.
  

What you will be doing:
  • Development, configuration, deployment and operation of our Kafka platform in a hybrid environment consisting of a mix of on-premises & cloud environments.
  • Implement DevOps pipelines & practices to streamline the development, testing, and deployment processes.
  • Work with the wider Data & Integration team and other cross-functional teams to operate, manage & maintain the Kafka platform.
  • Configure, deploy and manage observability components for operational reporting and capacity management of data platforms using tools like OpenTelemetry, ServiceNow Observability, Grafana, ELK etc.
  • Communicate effectively with team members and stakeholders on updates, challenges & solutions.
  • Build out standard operating procedures, fulfil service requests, resolve incidents and analyse problems.
  • Work closely with the development and support teams to effectively support, enhance and maintain technical solutions.
  • Adhere to change management and other operational policies.
  • Participate in intraday and after-hours support arrangements.
  
What you will bring:
Must have
  • Successfully built, deployed and operated a Kafka cluster in a Production environment.
  • Have experience in building, deploying and managing services in the cloud using DevOps tooling.
  • Have experience as a platform engineer with UNIX, Windows knowledge.
  • Excellent technical problem-solving skills.
  • Proven record of delivering technical solutions that meet set requirements.
  • Operated in, or developed reasonable understanding of, finance services.
  • Exposure to enterprise management tools.
  
Nice to have
  • Experience working in a multi-cloud environment.
  • ServiceNow/OpenTelemetry/Grafana/Telegraf/InfluxDB/ELK for monitoring & dash-boarding.
  • Exposure to API Gateway tools like Apigee.
  • Agile experience.
  • Trading system knowledge or applied knowledge of financial industry systems.
  • Familiarity with infrastructure-as-code tools like Terraform/CloudFormation.
  • Familiarity with Database like MS SQL Server, MySQL and Oracle.
  • Familiarity as a user with automated service desk, incident, problem and change management tools.
  • Experience with scripting in Shell, Perl, Python.
  • Familiarity with Automated Testing Tools.
Please reach out via oliver@preactarecruitment.com or 0455 198 736 for more details!
JobAdder.com