Strong real-life experience in python development especially in PySpark in AWS Cloud environment
Experience in Python and common python libraries
Strong analytical experience with the database in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.
Demonstrated experience resolving complex data integration problems
Experience in Pyspark, AWS, EMR, Cloud Formation, Redshift, Athena
Roles and Responsibilities
Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate client's enterprise systems in our Enterprise Data Platform
Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities