Framingham, MA




Location: MA


Duties and Responsibilities:
Lead the architecture and development of the Databricks frontend for Apache Spark
Write code for Databricks Runtime and provide feedback to the pull requests of other team members.
Work both as an individual and in a team to deliver features and architectural improvements.
Work directly with Product Management and Design to plan, develop and iterate on prototypes.

Required Technical Skills:
4+ years of production level experience on a full stack product
experience with modern JavaScript frameworks (e.g., React, Angular, Vue)
AWS databricks integration experience
Advanced experience with different query languages (i.e. T-SQL, PostgreSQL, PL-SQL)
Install, configure, maintain and troubleshoot Redhat Linux servers
Experience with AWS Infrastructure design/deployment (S3, EMR, Glue, API Gateway, EC2 etc.,)
Experience with AWS CLI and SDK
Experience with Presto deployments
Experience of DevOps experience in the AWS Cloud
Experience with large scale data migration
Experience with AWS networking and troubleshooting
Experience with AWS CI/CD pipeline deployment using open source or AWS native tools
Experience in creating deployment pipelines from the scratch
Experience with integrating infrastructure with Advanced Analytics tools (e.g. Amazon Sagemaker, Databricks, etc