Job Description
Job Description
Hello There,
My name is Himanshu Sharma, and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at Himanshu01@kanakits.com .
Job Description
Position : Big Data Engineer
Location : Malvern, PA Hybrid
Duration : Initial 12 months + options to extend - Long term contract role
Responsibilities
- Collaborate on the Smartstream cash reconciliation platform, known as TLM, to support data integration and transformation workflows.
- Design and implement ETL processes using tools like AWS Glue, Spark, or Python to transform raw data into structured formats compatible with Smartstream’s ingestion requirements.
- Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S3 buckets, ensuring consistency and accuracy across systems.
- Ensure data quality and lineage through validation checks, anomaly detection, and documentation of data assumptions
- Integrate data sources into cloud platforms such as AWS, leveraging services like S3, Glue, Lambda
- Work closely with product owner and business to understand data requirements, translate them into technical specifications
- Implement data governance principles, including version control, access management, and compliance with Vanguard and GIFS standards
Qualification: (8+ minimum experience)
- AWS Skills - Glue Lambda S3 KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)