Search

Big data Engineer

Technology

Job Description

Title: Big data Engineer

Location: St Louis, MO onsite

Contract Type: W2 Contract Only


Must Have Skill: Spark, Scala, PySpark, Python is mandatory skills.


Role Overview:

Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities across Mastercard. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI tools

High level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processes


Core skills:

  • Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)
  • Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform)
  • Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)
  • Strong SQL
  • AI agent knowledge
  • Team schedule: Onsite Monday, Tues and Fri

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...