LLM Engineer (100% Remote within Poland)

Docplanner•Published 2 hours ago•First seen 2 hours ago

Welcome to the good side of tech đź‘‹

You might have heard about us, but with a different name: ZnanyLekarz. It all started 14 years ago when we asked ourselves: is anyone in healthcare thinking about patients? We jumped in and we empowered patients by giving them access to leave and read reviews about their visit. We then provided doctors with the technology to manage bookings easily and save time, so they could devote themselves to what they always wanted: treating patients. And today is the day in which we ask you: wanna join us in the next step of making the healthcare experience more human?

Docplanner at scale

We are leaders in 13 countries so far, and more than 90 million patients trust us every month. 300k+ specialists believe in us and our product, and so do leading venture capital funds such as Point Nine Capital, Goldman Sachs Asset Management and One Peak Partners. And yet, employing over 3.000 people all over the globe, we managed to keep the startup-mindset we started with over 14 years ago.

At Docplanner we are a diverse group of over 300 people working in Engineering, Data, and Product teams. We are responsible for building the product for all locations. Many of us have been here for over 5 years, yet we still welcome each new person with great joy and excitement.

We could tell you about us, but we will let our reviews on Glassdoor speak for themselves. In case you’d like to see how it feels to be 100% yourself at work, here’s a video of us.

And why should you join us?

Because it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs.

We want to make the healthcare experience more human, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all . We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote friendly.

Job Description

As a LLM Engineer on the Platform AI team, you will take ownership of end-to-end LLM capabilities initiatives supporting our product teams with LLM engineering. You will be expected to drive technical excellence, champion best practices across the team, and actively shape our evolving tech stack and workflows. The new challenge is to help teams fulfill regulatory requirements (e.g., the AI Act) through processes that include proper prompt management, automated prompt and model evaluations, mitigation of unsafe model behavior, robust audit logging, and ensuring appropriate human oversight.

In this role, you’ll work alongside exceptional engineers, product stakeholders, and other cross-functional leaders on one of Docplanner’s most strategic initiatives, leveraging a cutting-edge tech stack to push the boundaries of AI in healthcare.

Our tech stack for LLM evals is built in Langfuse, custom Python or “live evals” in application. Or new applications are built in TypeScript in monorepo. We also have systems in .Net, PHP and Python. For LLMs we are using mainly models from OpenAi, but also Antropic and Google.

You will be responsible for:

  • Taking technical leadership of NLP initiatives, working closely with scientists, engineers, and product stakeholders to deliver AI-driven solutions that directly support strategic business objectives.
  • Implementing and evaluating LLM-based solutions at scale.
  • Validating, monitoring, and supporting models and the environment in a production setup.
  • Researching, architecting, and deploying LLM-powered information retrieval solutions to deliver accurate and scalable results in complex, multilingual product environments; championing industry-leading frameworks and evangelizing their adoption across the organization.
  • Monitoring changes in data characteristics in production to ensure ongoing reliability.
  • Selecting the best parameters for inference and continuously optimizing model performance.

What will set you up for success in this role?

  • Experience & Foundation: Solid Software Engineering background with at least 2 years of experience in LLM engineering in a fast-paced, product-driven environment.
  • Production LLMs: Proven ability to integrate, deploy, and optimize large language models in production, ensuring high scalability and robust performance.
  • Advanced AI Workflows: Hands-on experience designing and creating agent-based workflows.
  • Rigorous Evaluation: Experience with LLM evaluation frameworks to ensure AI outputs are accurate, safe, and reliable for end users.
  • Product & Business Mindset: A problem-solving approach focused on solving real user problems and delivering measurable business value, rather than just experimenting with new technology.
  • Cross-Functional Collaboration: Strong communication skills with a track record of influencing stakeholders across Product, Marketing, and Engineering, translating technical limits and opportunities into business goals.
  • Execution & Delivery: Adaptable in dynamic environments with a proven ability to manage timelines, prioritize high-impact tasks, and deliver under tight deadlines.
  • Technical Leadership: Experience mentoring other engineers, fostering continuous growth, and driving a high-performance culture within the team.

Let’s talk money

  • A salary adequate to your experience and skills.

True flexibility and work-life balance

  • Remote or hybrid work model with or hub in Warsaw;
  • Flexible working hours (fully flexible, as in most cases you only have to be on a couple of meetings weekly);
  • 20/26 days of paid time off (depending on your contract);
  • Additional paid day off on your birthday or work anniversary (you choose what you want to celebrate).

Health comes first

  • Private healthcare plan with Signal Iduna for you and subsidized for your family.
  • Multisport card co-financing for you to have access to sports facilities across Poland.
  • Access to iFeel, a technological platform for mental wellness offering online psychological support and counseling.

Keep growing with us

  • Free English and Spanish classes.

We promote and embrace equal opportunities in our hiring process, and also every day at work. When you apply for our roles you receive equal treatment regardless of age, disabilities, gender reassignment, marital or civil partner status, pregnancy or parental status, race, colour, nationality, ethnic or national origin, religion or belief, sex, sexual orientation or any other dimension of human difference. If you require additional support in your recruitment process, we kindly encourage you to let us know. Behind those words you’re reading, there’s a person (hi!) who already helped a candidate by adapting the interviews, and now we’re lucky to have this person with us. So, even if you’ve never asked for it before, may this serve as a sign that, now, you can do so. We can only truly be equal if we adapt to each other.

“We believe all humans, in all their beautiful diversity, should have equal rights, dignity and respect. Period.” Mariusz Gralewski, CEO