Seeking a senior Pyspark Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems.
This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting .
Key responsibilities
- Develop and optimize scalable PySpark-based data pipelines for processing and analyzing large scale financial data
- Design and implement distributed computing solutions for risk modeling , pricing and regulatory compliance
- Ensure efficient data storage and retrieval using Big Data
- Implement best practices for spark performance tuning including partition, caching and memory management
- Maintain high code quality through testing , CI/CD pipelines and version control (Git, Jenkins)
- Work on batch processing frameworks for Market risk analytics
Qualifications and Skills
- Strong experience in software development with experience in PySpark and Big data frameworks
- Strong proficiency in Python and Pyspark with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc)
- Experience working in financial markets , risk management and financial instruments
- Familiarity with market risk concepts including VaR, Greeks, scenario analysis and stress testing
- Hands on experience with Hadoop, Spark
- Proficiency on Git, Jenkins and CI/CD pipelines
- Excellent problem solving skills and strong mathematical and analytical mindset
- Ability to work in a fast paced financial environment
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Applications Development
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Citi is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View the "EEO is the Law" poster. View the EEO is the Law Supplement.
View the EEO Policy Statement.
View the Pay Transparency Posting
Top Skills
Citi London, England Office
33 Canada Square, London, United Kingdom, E14 5LB
