Softermii
Data Engineer (Python/Databricks)
Job Summary
The role involves developing and maintaining scalable data pipelines using Databricks and Apache Spark, collaborating with data scientists and analysts to provide high-quality data sets for analytics and machine learning. Candidates should have at least 3 years of experience in data engineering, proficiency in Python and SQL, and a strong understanding of data lakehouse architecture and distributed computing. The position offers opportunities for professional growth, mentoring, and flexible work arrangements, with a focus on data quality, governance, and performance optimization. The environment emphasizes teamwork, continuous learning, and employee well-being.
Required Skills
Benefits
Job Description
About the company:
Softermii (https://www.softermii.com/) is an outsourcing/outstaffing company with more than 8 years of experience in web and mobile application development with a team of more than 120 specialists from 6 countries.
We have withstood multiple challenges, such as COVID-19 pandemic and war aggression against Ukraine, we have secured sustainable development processes, saved all our projects and jobs. Even more – we’re constantly growing.
Every day we add new project to our portfolio in the following areas of expertise:
- Healthcare
- Real estate
- Livestream E-commerce
- Fintech (WealthTech, Capital Trading)
- Real Time Communications (RTC)
In addition, we develop 2 of our own solutions that help our customers get faster applications for video or audio calls (https://www.softermii.com/solutions/vidrtc) or an application for real estate with 3D visualization
(https://www.softermii.com/solutions/apartmii)
Company’s mission:
Softermii: Succeed Without (L) imitations
We will turn any idea into a valuable product.
Our plans as a company:
We want to move from a regular outsourcing business to an ecosystem of outsourcing, education and product development companies.
📲Project:
Team's goal is to deliver Hotel Business Management solution in a few phases starting MVP.
This tool will enable users to focus on Revenue Management, cover Guest Check-In experience, Marketing & Retention, Analytics & Reporting, Service Desk and other features that market requires.
Type of cooperation: Full-time
⚡️Your responsibilities on the project will be:
- Develop and maintain scalable data pipelines using Databricks (Apache Spark) for batch and streaming use cases.
- Work with data scientists and analysts to provide reliable, performant, and well-modeled data sets for analytics and machine learning.
- Optimize and manage data workflows using Databricks Workflows and orchestrate jobs for complex data transformation tasks.
- Design and implement data ingestion frameworks to bring data from various sources (files, APIs, databases) into Delta Lake.
- Ensure data quality, lineage, and governance using tools such as Unity Catalog, Delta Live Tables, and built-in monitoring features.
- Collaborate with cross-functional teams to understand data needs and support production-grade machine learning workflows.
- Apply data engineering best practices: versioning, testing (e.g., with pytest or dbx), documentation, and CI/CD pipelines.
You can be part of the following team:
Client`s side: Business Owner, Senior AI/ML Engineer, Data Engineers, Subject Matter Experts.
On Softermii`s side: Software Architect, 2-3 React.js/Node.js Engineers, 2-3 AI/ML Engineers, 3 Data Engineers, DevOps, Business Analyst/Proxy PO, UI/UX Designer
2-3 Quality Assurance Engineers, Project Manager.
🕹Tools we use: Jira, Confluence, Git, Figma
🗞Our requirements to you:
- 3+ years of experience in data engineering or big data development, with production-level work on the Databricks platform.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Proficiency in Python (or Scala) and SQL for data processing and transformation on Spark.
- Hands-on experience with Apache Spark, Delta Lake, and Databricks Notebooks.
- Familiarity with Databricks Workflows, Unity Catalog, and Delta Live Tables for managing and securing data pipelines.
- Solid understanding of data lakehouse architecture, distributed computing, and performance tuning on Spark.
- Experience integrating data from cloud sources like AWS S3.
- Knowledge of orchestration tools (e.g., Airflow, Databricks Jobs), and CI/CD practices for data pipelines.
- Strong communication and collaboration skills, with a team-oriented mindset.
- Upper-Intermediate English level.
👨💻Who will you have the opportunity to meet during the hiring process (stages):
Call, HR, Tech interview, PM interview.
What we can offer you:
- We have stable and highly-functioning processes – everyone has their own role and clear responsibilities, so decisions are made quickly and without unnecessary approvals.
- You will have enough independence to make decisions that can affect not only the project but also the work of the company.
- We are a team of like-minded experts who create interesting products during working hours, and enjoy spending free time together.
- Do you like to learn something new in your profession or do you want to improve your English? We will be happy to pay 50% of the cost of courses/conferences/speaking clubs.
- Do you want an individual development plan? We will form one especially for you + you can count on mentoring from our seniors and leaders.
- Do you have a friend who is currently looking for new job opportunities? Recommend them to us and get a bonus.
- And what if you want to relax? Then we have 21 working days off.
- What if you are feeling bad? You can take 5 sick leaves a year.
- Do you want to volunteer? We will add you to a chat, where we can get a bulletproof vest, buy a pickup truck or send children's drawings to the front.
- And we have the most empathetic HRs (who also volunteers!). So we are ready to support your well-being in various ways.
A little more information that you may find useful:
- our adaptation period lasts 3 months, this period of time is enough for us to understand each other better;
- there is a performance review after each year of our collaboration where we use a skills map to track your growth;
- we really have no boundaries in the truest sense of the word – we have flexible working day, remote or office is up to you.
Of course, we have a referral bonus system. So if you have a friend who likes our job opening, you can give us their telegram contact, and we in turn will thank you with a bonus if we start working with them!
Softermii
Softemii offers top-notch software and custom app development services worldwide with skilled professionals and timely results.
See more jobsSafe Remote Job Search Tips
Verify Employer Thoroughly
Research the company's identity thoroughly before applying. Check for a professional website with contacts, active social media, and LinkedIn profiles. Verify details across platforms and look for reviews on Glassdoor or Trustpilot to confirm legitimacy.
Never Pay to Get a Job
Legitimate employers never require payment for applications, training, background checks, or equipment. Always reject upfront payment requests or demands for bank details, even if they claim it's for purchasing necessary work gear on your behalf.
Safeguard Your Personal Information
Protect sensitive data like SSN, bank details, or ID copies. Share this only after accepting a formal, written job offer. Ensure it's submitted via a secure company system or portal, never through insecure channels like standard email attachments.
Scrutinize Communication & Interviews
Watch for communication red flags: poor grammar, generic emails (@gmail), vague details, or undue pressure. Be highly suspicious of interviews held only via text or chat apps; legitimate companies typically use video or phone calls.
Beware of Unrealistic Offers
If an offer's salary or benefits seem unrealistically high for the work involved, be cautious. Research standard pay for similar roles. Offers that appear 'too good to be true' are often scams designed to lure you into providing information or payment.
Insist on a Formal Contract
Always secure and review a formal, written job offer or employment contract before starting work or sharing final personal details. Ensure it clearly defines your role, compensation, key terms, and conditions to avoid misunderstandings or scams.