Improve Azure AI infrastructure

In addition to new software features, Azure is adding more AI-specific infrastructure tools. AI applications hosted in Azure Container Apps can now use serverless GPUs for inference, zeroing out Nvidia hardware when not in use to reduce costs. Other options improve container security to reduce the risks associated with using LLM on sensitive data, whether personally identifiable information or commercially sensitive data from business platforms.

Ignite is where Microsoft focuses on its enterprise software, so it’s the right place to launch a development product like Azure AI Foundry. Azure AI Foundry is designed to integrate AI into the complete software development lifecycle, from design and evaluation to coding and operations, providing a common space for developers, AIops, data scientists and business analysts to work together with the tools needed to create the next generation of AI applications.

With agentic AI applications, it’s clear that Microsoft believes it’s time for businesses to move beyond the chatbot and use AI to realize the benefits of flexible and intelligent process automation job. By leveraging Azure AI Foundry and Semantic Kernel, we are able to deliver the context-aware long transaction applications we wanted to build, ensuring they are both reliable and regulatory compliant.