top of page

Microsoft has released an open-source tool to test the security of artificial intelligence systems.

May 11, 2021
3 min read

To better understand ML system security, Microsoft conducted a study titled 'Adversarial Machine Learning - Industry Perspectives.'

Visuals, audios, emails, and other forms of feedback are used by artificial intelligence systems. Filtering, handling, and identifying malicious inputs and behaviours has become more difficult as a result. Cybersecurity is one of the top challenges for businesses all over the world. According to an Adversa survey, the number of AI Security papers has increased from 617 in 2018 to over 1500 in 2020, indicating that cybersecurity is becoming increasingly important.


Microsoft recently announced the open-source release of Counterfit, a tool for testing the security of AI systems.


The tech giant's latest move has the potential to be a game-changer in terms of establishing a robust AI ecosystem.


Behind the scenes in technology

When it comes to penetration checking and red teaming AI programmes, the tool comes in handy. The tool is already trained on the worst possible attacks thanks to pre-installed published attack algorithms. Security professionals may also use the target interface and built-in cmd2 scripting engine to bind to Counterfit from existing offensive tools.


According to the Microsoft blog, "This method was born out of our own need to test Microsoft's AI systems for vulnerabilities in order to proactively protect AI services, in line with Microsoft's responsible AI concepts and Responsible AI Strategy in Engineering (RAISE) initiative."

The tool aims to make attacks publicly accessible to the security community so that quick corrections can be made, as well as providing an interface for creating, managing, and launching attacks on models. Furthermore, it uses terms and workflows that are similar to Metasploit or PowerShell Empyre, which are already in use offensive tools.


Microsoft recommends using Counterfit in combination with the Adversarial ML Threat Matrix, an MITRE and Microsoft-developed ATT&CK-style system for detecting AI threats.


Counterfit is a tool for scanning AI models. Security professionals may use the norm, set random parameters, or customise an AI model for extensive vulnerability coverage. Organizations will use the tool to detect attacks, and if the flaws are patched, the tool would be better able to plan for potential attacks. Counterfit also has logging features that can be used to monitor attacks on a target model. The analysis' data insights could help data scientists and engineers better understand how AI systems fail.


Microsoft previously conducted a study titled "Adversarial Machine Learning – Industry Perspectives" in order to better understand the security of ML systems. According to the report, tech giants such as Google, Amazon, Microsoft, and Tesla have heavily invested in machine learning systems.


“Through interviews with 28 organisations, we discovered that most machine learning engineers and incident responders lack tactical and strategic tools to protect, identify, and respond to adversarial attacks on industry-grade machine learning systems,” Microsoft said.


a way forward

Computer vision algorithms can be messed up by applying tiny black and white stickers to stop signs, according to AI researchers. Even the most advanced deep neural networks can fail due to small input perturbations, according to the research. This could have disastrous results.


Since AI-powered machines are increasingly replacing humans in a variety of positions, AI system security is critical for reliability, protection, and justice. AI and machine learning systems are usually made up of a combination of open-source libraries and code written by non-security experts. In addition, no industry-accepted best practises for designing stable AI algorithms exist. Counterfit is a must-have, particularly in light of the solarigate scandal and rising cybersecurity breaches.



To help their work, Newsmusk allows writers to use primary sources. White papers, government data, initial reporting, and interviews with industry experts are only a few examples. Where relevant, we also cite original research from other respected publishers.


Source- Analytics India Mag





13 Comments


Heil Krone
Heil Krone
5 days ago

Really helpful posts! I liked that you covered the smaller details instead of just repeating the major GTA 6 and Path of Exile news. There's quite a bit to think about before launch, and these breakdowns give players a better idea of what to expect. I've also come across discussions about buy GTA 6 Money, buy POE2 Currency, and buy POE Currency, though I'll wait until GTA 6 launches and the new Path of Exile league goes live before deciding whether any of them are worth considering.

Like

Heil Krone
Heil Krone
5 days ago

Nice breakdown! It's easy to miss those tiny details ahead of launch. I've seen a lot of community talks about buying Divine Orb and Mirror of Kalandra, but I'm holding off. I want to check in-game drop rates and market stability once the league goes live before making any decisions.

Like

Heil Krone
Heil Krone
5 days ago

Nice breakdown! It's easy to miss those tiny details ahead of launch. I've seen a lot of community talks about buy POE Items, but I'm holding off. I want to check in-game drop rates and market stability once the league goes live before making any decisions.

Like

Really helpful post! I liked that you covered the smaller details instead of just repeating the major GTA 6 news. There's quite a bit to think about before launch, and this gives players a better idea of what to expect. I've also come across discussions about buy GTA 6 Boosting, though I'll wait until the game is out to see whether it's something worth considering.

Like

This was a helpful breakdown, especially the details that are easy to miss when following GTA 6 news. With launch getting closer, it's useful to have a clearer idea of what to expect. I've also been comparing a few options to GTA 6 Account, so taking time to check the details and understand what's available makes sense before making a decision.

Like
bottom of page