Big data Engineer
Technology
Job Description
Title: Big data Engineer
Location: St Louis, MO onsite
Contract Type: W2 Contract Only
Must Have Skill: Spark, Scala, PySpark, Python is mandatory skills.
Role Overview:
Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities across Mastercard. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI tools
High level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processes
Core skills:
- Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)
- Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform)
- Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)
- Strong SQL
- AI agent knowledge
- Team schedule: Onsite Monday, Tues and Fri
