Job Description: Pyspark Expertise Expert proficiency in Pyspark Ability to design and implement efficient data processing workflows Experience with Pyspark SQL and DataFrames Good exposure to Big Data architectures and good understanding of Big Data eco system Experience with some framework building experience on Hadoop Good with DB knowledge with SQL tuning experience Good to have experience with Python APIs and exposure to Kafka Key Responsibilities: Team Management Lead and manage a team of technical professionals Data Engineer and Application Developers ensuring effective collaboration and productivity Client Interaction Serve as the primary point of contact for clients understanding their needs and ensuring successful project delivery Status Reporting Prepare and present detailed status reports on ongoing projects to stakeholders highlighting progress risks and mitigation plans Issue Resolution Proactively identify and resolve any technical challenges or roadblocks faced by the team ensuring smooth project execution Project Management Oversee the entire project lifecycle from planning to execution ensuring timely delivery within scope and budget Technical Requirements: Pyspark Bigdata Spark Python Databricks AWS Additional Responsibilities: Ability to develop value creating strategies and models that enable clients to innovate drive growth and increase their business profitability Good knowledge on software configuration management systems Awareness of latest technologies and Industry trends Logical thinking and problem solving skills along with an ability to collaborate Understanding of the financial processes for various types of projects and the various pricing models available Ability to assess the current processes identify improvement areas and suggest the technology solutions One or two industry domain knowledge Client Interfacing skills Project and Team management Preferred Skills: Technology->Big Data - Data Processing->PySpark