• Refactored.io
  • Posts
  • Developing AI-powered apps 👨🏻‍💻

Developing AI-powered apps 👨🏻‍💻

Plus: NYC is now using AI to detect fare evasion 🥷🏻

July 24, 2023

Hey folks,

In today’s update:

đź“° News: Quickly build production ready AI apps

🛠️ Tools: Marketplace to buy voices

🎲 Misc: NYC is using AI to detect fare evasion 🥷🏻

Reading time is 4 minutes. Let’s dive in 🤿

 Startups

Building production-ready AI apps

The quality of AI models has improved dramatically over the last couple of months, but the engineering tools haven’t caught up.

Today, you could spin up a chatbot on your data in as little as 5 lines of code, but running it in production is a whole different problem.

LangSmith, by the same team behind LangChain, is a new development framework to simplify building AI applications.

LangSmith is a unified platform to:

  • Debug: Identify and fix issues quickly with deep visibility into model performance.

  • Test: Understand how the changes impact your applications chains and prompts to test effectively.

  • Evaluate: Integration with open-source evaluation modules offers heuristic and LLM evaluations for your AI model.

  • Monitor: Track system-level performance, debug issues, understand user interactions, and optimize performance based on feedback using the monitoring tools.

Bigger Picture: Even though AI models are getting smarter, there is no straightforward answer to the simple question of “what’s happening inside the AI model?”, let alone getting them to work reliably.

Similar to software engineering, new tools are emerging to help developers abstract away common infrastructure and focus on what really matters - building their applications.

LEVERAGE AI

Test LLM prompts

BenchLLM: A free open-source tool that allows you to test hundreds of prompts and responses on the fly. Automate evaluations and benchmark models to build better and safer AI, along with ability to monitor model’s performance and detect regressions. (link)

Marketplace for voices

Voice-Swap: A tool where you can create, collaborate, and innovate using the voices of iconic artists. Just upload your vocals, choose a singer and then you can download an acapella in their voice.(link)

 MISC

What’s happening in Tech

  • StabilityAI releases new open source AI models competitive with ChatGPT - StabilityAI

  • Top 7 AI companies, including Google, OpenAI and Meta make “AI Safety Commitments” to the White house - Techcrunch

  • ChatGPT will now be available on Android beginning this week - OpenAI

  • NYC’s subway is now using AI powered facial recognition software to track fare evasion - NBC