Attackers Target AI Infrastructure to Steal Credentials
Microsoft documented compromises of three software platforms, LiteLLM, RAGFlow, and Kestra, that also gave attackers lasting access and hijacked computing power.
Key takeaways
- Microsoft documented real attacks on installations of LiteLLM, RAGFlow, and Kestra, three software platforms used to operate AI and other business systems.
- Attackers entered through exposed or vulnerable software. They attacked the infrastructure surrounding AI models, not the models themselves.
- The attackers stole AI provider credentials, maintained access to compromised systems, and used company computing power to mine cryptocurrency.
- Microsoft said AI infrastructure should receive the same security protections as other critical company systems.
- The research did not identify the affected organizations, the attackers, or how widespread these attacks have become.
Microsoft Security Research documented attacks against three AI infrastructure systems that allowed attackers to steal credentials, maintain access, and use company computing resources for cryptocurrency mining.
The AI infrastructure attacks involved LiteLLM, RAGFlow, and Kestra. These systems perform different jobs, but each can connect AI models with company applications, stored information, credentials, and computing resources.
That access made the systems valuable targets. Microsoft said attackers used different entry points but repeatedly pursued credentials, lasting access, data, and computing power.
Microsoft did not identify the affected organizations or the attackers. Its research describes three investigations and does not establish how common such attacks have become.
LiteLLM attackers stole keys and database records
LiteLLM serves as a gateway between company applications and AI model providers. It can hold API keys, which are secret codes that authorize access to services from companies such as OpenAI, Anthropic, and Microsoft.
Microsoft said attackers likely entered through security weaknesses in an internet-accessible LiteLLM gateway. They searched the system for AI provider keys, passwords, database connection details, and other credentials.
The attackers then used a stolen database connection to access records containing AI model settings and additional keys. Microsoft also observed attempts to send the stolen information to attacker-controlled systems.
The attack went beyond credential theft. The attackers installed cryptocurrency-mining software, added an SSH key that could provide continued access, and created processes intended to survive system restarts and resist removal.
RAGFlow attack intercepted new AI credentials
RAGFlow helps AI systems search and use information stored in documents. It also stores the credentials needed to connect with AI model providers.
In the case Microsoft investigated, attackers changed the RAGFlow application to capture newly entered AI provider credentials and send them outside the organization. The malicious code was connected to the application’s startup process, allowing it to load again when the service restarted.
Microsoft said it could not determine which security weakness enabled the attackers to run code inside RAGFlow. It identified several publicly reported weaknesses that could provide context but did not attribute the attack to any one of them.
Microsoft did not observe cryptocurrency mining or an interactive remote connection in this case. The attack primarily targeted credentials entered after the malicious code was installed.
Kestra attackers hijacked computing power
Kestra lets organizations automate tasks across software and computing systems. Microsoft said attackers likely exploited a security weakness that allowed them to bypass its login protections and create a malicious automated task.
That task allowed the attackers to run commands, inspect information held by connected software containers (isolated environments used to run applications), and collect credentials and other data.
The attackers also installed XMRig, software used to mine the Monero cryptocurrency. This allowed them to consume the organization’s computing power for their own profit.
Microsoft observed later activity that collected additional system information and stored it through Kestra’s own data-storage feature.
Microsoft urges tighter controls
Microsoft recommended that organizations prevent AI management tools from being directly accessible through the internet and install security updates promptly.
The company also recommended issuing separate AI service keys to individual teams, limiting how much each key can spend, and storing master credentials outside the applications that use them. Organizations should replace credentials associated with an exposed system.
Microsoft said organizations should limit what AI infrastructure can access and monitor it for signs of unauthorized activity.