Bioinformatics Data Engineering: Genomics to Analytics
Build bioinformatics data pipelines with sample identity, reproducible genomics processing, governed analytics and careful ML evaluation from ingestion to release.
Read article07 / Journal
Thoughts from buildingreal AI systems.
Notes on LLM and RAG systems, MLOps, data engineering and the craft of shipping software that has to keep working.
- 39
- Articles published
- 21
- Topics covered
02 / All articles
Everything I’vewritten down.
Filter by topic or search for a specific problem.
38 articles
AI Agents in Production: Architecture, Tools, Memory and Guardrails
AI agents in production need clear tool boundaries, durable state, scoped memory and tested recovery. Build an architecture that makes failures understandable.
Read article
Multi-Agent Systems with LangGraph: Orchestration Patterns That Scale
Choose multi-agent orchestration patterns by dependency, ownership and failure behavior. Learn how LangGraph state, routing and checkpoints support reliable workflows.
Read article
Production RAG: Chunking, Hybrid Search, Reranking and Evaluation
Design a production RAG pipeline from ingestion to evaluation, with practical decisions for chunking, hybrid retrieval, reranking, permissions and grounded answers.
Read article
LLMOps in Practice: Evaluate, Trace and Monitor LLM Applications
Connect offline evaluations to production traces and useful alerts. Build an LLMOps process that explains regressions, protects private data and supports controlled releases.
Read article
Modern Lakehouse Architecture with Apache Iceberg, dbt and Airflow
Define clear responsibilities for storage, table metadata, SQL transformations and orchestration. Build a lakehouse that supports repeatable runs and trustworthy datasets.
Read article
Data Contracts and Data Quality Checks for Reliable Pipelines
Turn dataset expectations into versioned contracts and useful quality checks. Learn how to handle schema changes, quarantine failures and recover without hiding broken data.
Read article
Real-Time Data Pipelines with Kafka and Change Data Capture
Build real-time pipelines around durable change events, explicit ordering and replay. Understand Kafka, CDC snapshots, idempotent consumers and recovery at the sink.
Read article
Analytics Engineering: A Metrics Layer and Dashboards Teams Trust
Create a metrics layer that preserves business meaning across dashboards. Resolve grain, joins, time windows and ownership before teams compare incompatible numbers.
Read article
Time Series Forecasting for Business: From Baseline to Production
Turn forecasting into a repeatable decision process. Start with baselines, validate through time, prevent leakage and monitor the forecast horizon the business actually uses.
Read article
From Notebook to Production: A Machine Learning Deployment Checklist
Move an ML model into production with reproducible artifacts, input contracts, controlled rollout and tested rollback. Use practical checks for both batch and online serving.
Read article
Introduction to Custom Machine Learning Models
Machine learning is a rapidly evolving field that offers endless possibilities for various industries. With new research and advancements being released regularly, it's now possible to leverage state-of-the-art machine learning models for your own data and applications. This article will guide you through the process of customizing machine learning models to suit your specific needs,…
Read article
Edge Functions Best Practices: Enhancing Web Applications with CloudFront
Edge functions are powerful developer tools that allow you to add custom logic at the edge with CloudFront, Amazon Web Services' (AWS) content delivery network. By leveraging edge functions, developers can enrich web applications, reduce latency, and build fully distributed applications. In this article, we will explore the best practices for utilizing edge functions effectively…
Read article
Building Real-Time Web applications with tRPC: A Comprehensive Guide
In today's digital world, real-time web applications have become increasingly popular, enabling users to experience instant updates and seamless interactions. One powerful tool that developers can leverage to build real-time web apps is tRPC. With tRPC, developers can create fully type-safe APIs using TypeScript, Next.js, Chakra UI, and Prisma ORM. This comprehensive guide will walk…
Read article
The Ethical Risks of Artificial Intelligence in Business
Artificial Intelligence (AI) has revolutionized various aspects of our lives, from healthcare to transportation. However, along with its numerous benefits, AI also poses ethical risks that businesses must address. These risks include the potential for bias, invasions of privacy, and even deadly accidents. As AI operates at scale, any problems that arise can have a…
Read article
Empowering Tomorrow: Unleashing the Potential of Big Data Solutions
In the vast digital landscape of today's interconnected world, data has become more than just a commodity - it is the lifeblood that fuels innovation, drives decision-making, and shapes the future of industries. At the forefront of this data-driven revolution stands the formidable arsenal of Big Data Solutions, a powerful suite of technologies and methodologies…
Read article
AI-Powered Apps: Revolutionizing Industries and Enhancing User Experiences
Artificial intelligence (AI) has become an integral part of our daily lives, transforming various industries and enhancing user experiences. From voice assistants to personalized shopping recommendations, AI-powered applications have revolutionized the way we interact with technology. The market for AI software is rapidly expanding, with the revenue expected to reach $126 billion by 2025. As…
Read article
Freelance Python Data Scientist: Unleashing the Power of Data
In the dynamic landscape of the tech industry, the role of data scientists has evolved, with a significant surge in the demand for freelance Python data scientists. In this blog we are trying to explore the reasons behind this rise, the essential skills required, and the steps to build a successful freelance career as a…
Read article
Deep Learning Techniques: Advanced Methods and Optimization Strategies
The magic of deep learning, riding on the wings of artificial intelligence (AI), has sparked a revolution across industries, enchanting them with groundbreaking innovations that defy the ordinary. At the core of this technological transformation lies the concept of deep neural networks, which emulate the intricate workings of the human brain. In this comprehensive guide,…
Read article
AI-Powered Apps with OpenAI: Enhancing Innovation and Development
AI full form is Artificial Intelligence that has revolutionized the way we interact with technology, and OpenAI leads the charge in this transformative journey, paving the way for a new era in the world of technology. With its advanced AI models like GPT-3, Codex, DALL-E, and Whisper, OpenAI has opened up a world of possibilities…
Read article
Data-Driven Decision Making: Unlocking Business Success
In today's data-driven world, organizations are increasingly realizing the importance of making decisions based on solid evidence rather than relying solely on intuition or observation. The ability to collect, analyze, and interpret data has become a key skill for professionals in various fields. In this comprehensive guide, we will explore the concept of data-driven decision…
Read article
Data Science Case Studies: Real-World Data Analysis Cases
In the intricate world where data intertwines with meaningful solutions, data science emerges as the guiding light, illuminating the path to innovation. This article embarks on a journey through the realms of real-world challenges and transformative solutions as we delve into a curated collection of Data Science Case Studies. These narratives, akin to chapters in…
Read article
The Latest Artificial Intelligence Innovator 2024
In the ever-evolving landscape of technology, Artificial Intelligence (AI) stands at the forefront, continually pushing boundaries and reshaping the way we interact with the digital realm. As we navigate the complexities of the 21st century, Artificial Intelligence Innovators are not just incremental improvements; they are transformative leaps that promise to redefine industries, augment human capabilities,…
Read article
Innovating the Future: Unveiling Cloud App Development Strategies
In the rapidly evolving landscape of technology, the fusion of data science and software engineering propels us into uncharted territories. As a seasoned data scientist and software engineer, my professional journey unfolds not merely as a pursuit of excellence but as a relentless exploration of innovation. This journey is not just about technological advancement; it's…
Read article
A Journey in User-Friendly Web Application Security
In the expansive world of the internet, where every click opens a gateway to information, entertainment, and commerce, the importance of robust web security measures cannot be overstated. As users traverse the digital landscape, the responsibility falls on the shoulders of developers, architects, and guardians of the virtual realm to ensure that these journeys are…
Read article
A Comprehensive Guide to Database Management and Integration in Software Engineering
In the ever-evolving realm of data science and software engineering, the orchestration and harmonization of databases emerge as linchpins for the smooth functioning and peak efficiency of operations. In my capacity as a seasoned practitioner in both data science and software engineering, I bring forth a wealth of experience and proficiency in the art of…
Read article
Mobile Application Architecture: React Native vs. Native
When it comes to mobile app architecture, React Native and Native development offer distinct approaches. Coming from an iOS and Android development background, I initially faced challenges transitioning to React Native. This new environment marked a significant shift, having primarily focused on mobile development. However, I viewed this change as an opportunity to expand my…
Read article
Building a Powerful GraphQL Server with Node.js: A Comprehensive Guide
Next.js is thought of as a frontend React framework. It provides server-side contribution, built-in routing process and many features related to performance. As Next.js supports the API routes, so it provides the backend and frontend to React, in the same package and setup. We will dive into the process of setting up a GraphQL Server with…
Read article
Challenges and Best Practices in Docker Container Security
Docker Security: A Comprehensive Guide Docker containers have become increasingly popular in recent years, but with this popularity comes increased security concerns. Containers are more complex than traditional virtual machines, and securing them can be challenging. In this article, we will discuss the importance of Docker security, the reasons for the complexity of Docker containers,…
Read article
Exploring Kubernetes Observability: A Comprehensive Tutorial Series
In our second installment of the Kubernetes Observability tutorial series, we'll dive deep into monitoring all facets of your applications operating within a Kubernetes environment. This includes a comprehensive examination of the following: Ingesting and analysing logs performance collection and health metrics Monitoring application performance with Elastic APM To aid us in this endeavor, our…
Read article
Remote Python Developer: Improve Your Python Development Skill
Models, a fundamental component of the Django framework, hold a central position in its architecture. Following Django's design principles for models is essential. This involves maintaining explicit naming and functionality within our fields and encapsulating all relevant model functionality within the model itself, rather than dispersing it elsewhere - a core tenet of Django's design philosophy. If…
Read article
5 Ways to Instantly Improve Your Angular Codebase
Angular is not that easy. It requires deep learning. Building easy to read and maintain apps is no doubt an art. This article shares 5 ways to improve your Angular codebase quality. It includes everything from naming your file, complicated topics such as redux to state management. Learn how you can use all these tips…
Read article
AWS Lambda with Node.js: Serverless Computing Simplified
Are you curious about AWS Lambda, the powerful service for building highly scalable, event-driven applications? It's no surprise that terms like 'serverless,' 'function-as-a-service,' and 'AWS Lambda' might leave you feeling a bit puzzled. But don't worry, you've come to the right place! This article is your guide to understanding AWS Lambda serverless technology, and it…
Read article
Let's Know How To Structure Large Flask Applications Step by Step
Creating and managing Large Flask Applications involves various methods and conventions. Many frameworks provide tools for automating and simplifying this task, but they all emphasize structuring the code base by logically distributing it across files and folders. Flask, a minimalistic web application development framework, offers a solution through its 'blueprints.' In this article, we'll explore…
Read article
Efficient Unit Testing with Jest for Gatsby, TypeScript, and React Testing Library
The task to set up Jest and React Testing library for TDD using Gatsby is an easy one.Its tricky as i planned to use Typescripts in my test. Firstly, i installed jest, babel-jest and babel-preset-gatsby ensuring the presence of babel preset(s) which can be used internally for Gatsby site. npm install --save-dev jest babel-jest babel-preset-gatsby identity-obj-proxy tslint-react…
Read article
Remote Typescript Developer: GraphQL, TypeScript and PostgreSQL API
The go-to stack in recent times for developers, especially Remote Typescript Developers, revolves around GraphQl and Typescript. While I have utilized Vanilla JavaScript in a recent project, my experience with Typescript has been extensive. Despite not having direct hands-on experience initially, I found great assistance through a tutorial that guided me effectively. In this article,…
Read article
Remote React App Developer - Best And Most Underrated Pattern Design
This snippet showcases a Modal component with customizable features. The inclusion of showCloseButton as a prop allows for dynamic control over the display of the close button, and within the Modal, distinct child elements like title, contents, dismiss button, and action button contribute to a modular and customizable design. As we delve into the details…
Read article
How TypeScript can be used with Node and Express?
At the onset of my career, I embraced strong-typed languages as a web developer. However, the allure of JavaScript and Python's dynamic features captivated me. The flexibility of not declaring variables enhanced my productivity and fueled my passion. Initially skeptical about TypeScript, a pivotal shift occurred in my mindset. What prompted this change? I adopted…
Read articleDiscuss an idea
Working on somethingyou want to talk through?
If one of these posts is close to a problem you have, tell me about it - I’m happy to compare notes.