IT Philosophy

Category: AI

  • I put an AI agent on our board

    I put an AI agent on our board

    —

    in

    Part 1 of 5 in a series on autonomous software delivery. This post introduces Ralph, our experimental autonomous development agent, and the thesis of the series: agent autonomy is an engineering problem, and it needs engineered frameworks, not vibes. Autonomous software delivery, a five-part series Part 1: I put an AI agent on our board…

  • AATB: our agent merges its own pull requests

    AATB: our agent merges its own pull requests

    —

    in

    Part 2 of 5 in a series on autonomous software delivery. Part 1 introduced Ralph, our autonomous development agent. This part covers AATB, the delivery flow that lets an agent ship to a shared environment safely. Part 3 covers how it tests. Autonomous software delivery, a five-part series Part 1: I put an AI agent…

  • ARBT: how the agent decides what to test, and proves it

    ARBT: how the agent decides what to test, and proves it

    —

    in

    Part 3 of 5 in a series on autonomous software delivery. Part 2 covered AATB, the flow where our agent Ralph merges its own pull requests. This part covers the testing and evidence behind that decision. Autonomous software delivery, a five-part series Part 1: I put an AI agent on our board Part 2: AATB:…

  • Governing the plan, not just the code

    Governing the plan, not just the code

    —

    in

    Part 4 of 5 in a series on autonomous software delivery. Part 2 and Part 3 covered how our agent Ralph delivers and tests a feature. This part covers the design decisions that need human agreement before implementation. Autonomous software delivery, a five-part series Part 1: I put an AI agent on our board Part…

  • From laptop loop to governed platform

    From laptop loop to governed platform

    —

    in

    Part 5 of 5 in a series on autonomous software delivery. The previous parts introduced Ralph, our autonomous development agent, and the delivery, testing and design practices around it. This part covers how other organisations can adopt those practices gradually. Autonomous software delivery, a five-part series Part 1: I put an AI agent on our…

  • We’re more like AI than we think: Exploring the human-LLM connection

    We’re more like AI than we think: Exploring the human-LLM connection

    —

    in , ,

    Rather listen than read? Check out this article’s podcast below. While we often highlight the impressive capabilities of AI, especially LLMs, we also focus on their shortcomings—particularly their tendency to “hallucinate” or generate information that isn’t grounded in reality. But what if these so-called flaws aren’t just quirks of machine learning? What if they reflect…

  • Evaluating LLMs: Using LLM-as-a-Judge for better GenAI evaluation

    Evaluating LLMs: Using LLM-as-a-Judge for better GenAI evaluation

    —

    in ,

    A couple of weeks ago, I had the pleasure of joining fellow GenAI enthusiasts and practitioners on a panel at Microsoft to discuss reducing hallucinations and improving relevancy in LLM calls and RAG pipelines. A key takeaway from our discussion was the importance of using LLM-as-a-Judge for evaluation. In this blog post, I want to…

  • GenAI: Bringing intuition to IT

    GenAI: Bringing intuition to IT

    —

    in ,

    In the realm of cognitive psychology, human thinking is often divided into two distinct systems: System 1 and System 2. Understanding these two modes of thinking is crucial for grasping the revolutionary potential of Generative AI (GenAI) within the current IT landscape. System 1 vs. System 2 Thinking System 1 thinking is intuitive, fast, and…

  • GPT 4o vs GPT 4 – Massive improvements

    GPT 4o vs GPT 4 – Massive improvements

    —

    in ,

    OpenAI just released GPT 4o for the public and I went on and tested it right away and the results are massive! So, I just reposted some of my recent GPT 4 prompts to GPT 4o and here are the results! First off the performance improvement is fantastic. Before GPT4’s performance was inconsistent, sluggish, and…

  • How AI will impact software development

    How AI will impact software development

    —

    in ,

    As we step further into the AI-driven era, the buzz around how it’s reshaping the tech landscape is loud and clear. Those of us knee-deep in enterprise software are seeing firsthand how AI tools like GitHub Copilot and ChatGPT at our fingertips are making coding a bit less daunting. AI coding is taking over as…