Understand batch processing from business and technical perspective Photo by Dannie Sorum on UnsplashWe live in a world where every human interaction becomes an event in the system, whether it’s purchasing clothes online or in-store, scrolling social media, or taking an Uber. Unsurprisingly, all these events are processed in one way or the other.…

Gain intuition behind acceleration training techniques in neural networks D eep learning made a gigantic step in the world of artificial intelligence. At the current moment, neural networks outperform other types of algorithms on non-tabular data: images, videos, audio, etc. Deep learning models usually have a strong complexity and come up with millions or even…

What it is and How to apply it to a real-world scenario Photo by Google DeepMind on UnsplashThis year, my resolution is to go back to the basics of data science. I work with data every day, but it’s easy to forget how some of the core algorithms function if you’re completing repetitive tasks. I’m…

Exploring the Transformer’s Decoder Architecture: Masked Multi-Head Attention, Encoder-Decoder Attention, and Practical Implementation This post was co-authored with Rafael Nardi. In this article, we delve into the decoder component of the transformer architecture, focusing on its differences and similarities with the encoder. The decoder’s unique feature is its loop-like, iterative nature, which contrasts with the…

Turn a government PDF into a financial planning tool Photo by Robert Murray on Unsplash!Hierarchical data is a data model where items are linked to each other in parent-child relationships, forming a tree structure. Some obvious examples are family trees and corporate organization charts. A treemap is a diagram that represents hierarchical data using nested…

Not to pick on Sebastian Bubeck in particular, but if auto-complete-on-steroid can “blow his mind,” imagine the effects on the average user. Developers and data practitioners use LLMs every day to generate code, synthetic data, and documentation. They too can be misled by inflated capabilities. It’s when humans over-trust their tools that mistakes happen. TL;DR:…

Photo by Nadine Shaabana on UnsplashDistance as a measure of difference This article discusses three measures of distance: (1) the Earth Mover’s Distance (EMD; Rubner et al., 1998); (2) the Word Mover’s Distance (WMD; Kusner et al., 2015); and (3) the Concept Mover’s Distance (CMD; Stoltz & Taylor, 2019). These measures build on one another…

Setting the foundations right Photo by Konta Ferenc on UnsplashIn the previous two articles we saw how we can implement a basic classifier based on Rosenblatt’s perceptron and how this classifier can be improved by using the adaptive linear neuron algorithm (adaline). These two articles cover the foundations before attempting to implement an artificial neural…

A step-by-step guide on deploying LlamaIndex RAGs to AWS ECS fargate Image generated by DALL-E 3 by the author· IaC Self-Service · High-Level Deployment Diagram · Overview of Pipelines · Infrastructure Pipeline ∘ terraform-aws-modules ∘ Implementation Prerequisites ∘ Step 1: Create GitHub environments ∘ Step 2: Add infrastructure pipeline code ∘ Step 3: Add…

LLMs today suffer from inaccuracies at scale, but that doesn’t mean you should cede competitive ground by waiting to adopt generative AI. Building an AI-ready workforce with data.world OWLs, as imagined by OpenAI’s GPT-4Every enterprise technology has a purpose or it wouldn’t exist. Generative AI’s enterprise purpose is to produce human-usable output from technical, business,…