InfoQ

UC Berkeley Researchers Open-Source API-Calling Language Model Gorilla

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Sophie Koonin discusses the realities of ...
Security Boulevard

What Is an LLM Proxy and How Proxies Help Secure AI Models

Explore how LLM proxies secure AI models by controlling prompts, traffic, and outputs across production environments and ...
InfoWorld

LiteLLM: An open-source gateway for unified LLM access

LiteLLM allows developers to integrate a diverse range of LLM models as if they were calling OpenAI’s API, with support for fallbacks, budgets, rate limits, and real-time monitoring of API calls. The ...
VentureBeat

Why “which API do I call?” is the wrong question in the LLM era

For decades, we have adapted to software. We learned shell commands, memorized HTTP method names and wired together SDKs. Each interface assumed we would speak its language. In the 1980s, we typed ...
InfoWorld

3 of the best LLM integration tools for R

Do you need to add LLM capabilities to your R scripts and applications? Here are three tools you'll want to know. When we first looked at this space in late 2023, many generative AI R packages focused ...
Morningstar

Traefik Labs Advances LLM and MCP Runtime Governance with Composable Safety Pipeline, Multi-Provider Resilience, and Token-Level Cost Controls

New capabilities extend Traefik Hub's Triple Gate architecture with guardrail integrations from NVIDIA, IBM, and Microsoft running in parallel, plus the ability for organizations to write their own ...