Evaluating Agentless Cloud Security Solutions?

Elias Terman
10 minutes Reading time

Here are the 7 questions you MUST ask your cloud security vendor

Vendor claims can make it difficult for defenders to separate fact from fiction. Orca Security is the cloud security innovation leader, is the inventor of SideScanning, and has the patent application dates to prove it.

Use the questions below to make an informed decision and make sure you include the relevant questions below in any public cloud security vendor RFP.

1 What types of cloud security risks are you able to detect within my environment?

Vendors that lack critical capabilities such as malware detection or the ability to identify sensitive data at risk can weaken your overall security posture and make it difficult to meet compliance mandates such as PCI-DSS, HIPAA, and GDPR.

As shown in the diagram below Orca detects the following types of risk:

  • Malware including both signature and heuristic-based detection
  • Vulnerabilities in operating systems, applications, and libraries
  • Insecure cloud configurations
  • Authentication risk such as weak and leaked passwords, as well as over-permissioned roles
  • Sensitive data at risk including PII
  • Lateral movement risk due to insecure keys and improper segmentation

“We needed a solution that could provide complete visibility into our cloud estate while also scanning for malware, identifying misconfigurations, and protecting PII.”

Shahar Maor
CISO
Fiverr

2 How does your solution ease our compliance efforts?

As noted above, having a complete solution that covers malware scanning and sensitive data at risk is critical to meeting compliance mandates.

Also, ask your vendor which compliance frameworks they support and how they make it easy to provide evidence to auditors.

As for Orca, we empower your security team to support continuous compliance with all key frameworks, including PCI-DSS, SOC 2, PSD2, GDPR, NIST-800, and HIPAA. Orca supports a wide range of CIS control benchmarks such as Apache CIS, AWS CIS, Azure CIS, Docker CIS, GCP CIS, Linux CIS, Windows CIS, and more.

In addition to out-of-the-box compliance templates, Orca supports customization and automation via Orca’s security context framework which includes auto-ticketing to Jira or ServiceNow for those repetitive or high-criticality cloud compliance issues.

With Orca, you can meet data privacy mandates such as PCI-DSS, GDPR, and HIPAA by showing regulators evidence of your ability to identify and protect sensitive data like PII. The Orca platform uniquely recognizes where sensitive data such as PII is located across your cloud estate and alerts you to all potential exploitation paths.

 

“Orca has helped reduce my audit effort; for example, I can run reports that show we maintain least privilege controls and that we use multi-factor authentication. Orca is great at detecting potential exposure of credit card data, email addresses, and social security numbers or other national IDs. These are priority issues that we can quickly remediate.”

Jonathan Jaffe
CISO
Lemonade

3 Are there any analyst reports, awards, or customer reviews that you can provide to further validate the maturity and trustworthiness of your solution?

Analyst Research Reports

Orca has dozens of satisfied and referenceable customers and public reviews:


CISO Choice Awards: 2020 Winner - Visionary Vendor
2020 Sinet 16 Innovator Award
CB Insights: 2020 Cyber Defenders - Multi-Cloud Security Award
Gartner peerinsights: Customer First Award
Gartner PeerInsights: 4.8 out of 5 Rating
Capterra: 4.8 out of 5 Rating
The Channel Co. CRN: 2020 Emerging Vendors Award
G2: Top 50 - Products for Cloud IT Management - 2021 Best Software Award
G2: Easiest Setup - Enterprise for Spring 2021 Award
G2: Best Support - Enterprise for Spring 2021 Award

“Orca’s combination of SaaS delivery, SideScanning technology, and access to cloud configuration APIs provides security visibility and context into different aspects of cloud security with less friction than agent-based approaches.”

Fernando Montenegro
Principal Analyst Information Security
451 Research

4 What certifications and competencies do you have to validate the security of your solution?

Orca Security has the following third-party certifications and validations:

  • ISO 27001
  • ISO 27017
  • ISO 27018
  • SOC 2 Type 2
  • AWS Security Competency

Orca Security is one of only nine companies in the cloud vulnerability and configuration analysis category to achieve the AWS Security Competency. This differentiates Orca Security as an AWS Partner Network (APN) member that provides specialized software designed to help enterprises adopt, develop and deploy complex security projects on AWS. To receive this designation, APN Partners must show that multiple customers have validated their technology for the specific competency, possess deep AWS expertise with a well architected infrastructure, and deliver solutions seamlessly on AWS.

5 How do you prioritize alerts / issues? What reasoning and details do you provide along with each alert / issue?

A few things to keep in mind here. Is the vendor able to clearly articulate how they prioritize alerts? Does the vendor’s priority levels look consistent across different types of issues / alerts? Does the vendor provide a clear rationale and explanation for why an alert is being categorized the way it is?

Alerts in Orca are graded according to the risk level they pose to your organization. There are four levels of risk, highlighted below from lowest (Informational) to highest (Compromised): 

Informational [Score 4]
Alerts with no clear attack vector and pose minimal risk to the organization, so are thus deemed informational.

Hazardous [Score 3]
Alerts with no known exploit or not reachable from the outside but still lessen your security posture.

Imminent Compromise [Score 2]
Alerts with a high probability that the machine will be compromised based on the findings and a viable external to internal attack vector. 

Compromised [Score 1]
Alerts when malicious code or activity is existing on the asset.

Alert Scoring can be upgraded or downgraded by taking multiple factors into consideration. Some examples are:

  • Whether the asset is Internet-facing or not (Orca builds a context map to understand the topology, even if the asset is behind a proxy, load balancer, etc.)
  • Vulnerability correlation to network services
  • The publication date of CVE 
  • Fix availability per package/CVE by the vendor
  • IOC – Indicator of Compromise (authentication logs, etc..)
  • Exploit availability per CVE
  • CVSS score baseline
  • Potential damage like remote code execution or denial of service 
  • Trending/High-Profile CVE (security blogs, threat intelligence, Twitter chatter, etc…)
  • Risky configuration (both the cloud control plane and workload risky configuration)
  • Asset state (running /shut down)

In the screenshot below, Orca is showing an unpatched web service vulnerability. As explained in the alert itself, its severity is justified by the fact that the resource is exposed to the Internet. The visual attack map helps you understand how a would-be attacker could access this resource from the Internet.

Screenshot from Orca’s UI showing how the platform handles alerts better than other cloud security vendors

Orca is the only vendor that effectively prioritizes alerts by taking a holistic approach to risk by combining workload data (vulnerabilities, misconfigurations, malware, file integrity monitoring), threat intelligence, and environmental context (accessibility and potential business impact).

“Orca gives us a graduated scale of vulnerabilities or threats, that’s incredibly valuable. The core item that most attracted me to Orca is that it aggregates all kinds of alerts—in disparate areas—into a single alert that makes sense. We don’t have the resources to spend all day trying to figure out what any given alert is telling us.”

Michael Myer
Chief Security and Innovation Officer
MRS BPO

6 How do you shorten time to resolution / remediation?

Alert prioritization is critical. Solutions that separate the 1% of alerts that matter help you focus your efforts on where they need to be. Equally important is that the solution give you a clear path forward to resolution.

For example, can the vendor’s solution not just detect a rogue SSH key in a workload, but also tell you what else in your environment those keys provide access to? Can the solution not only find malware but also tell you if the machine that they found it on is accessible? How will the vendor’s solution guide you in containing the damage?

Can the solution not only detect cloud keys that a developer has embedded in a test script but also tell if those keys are for accounts that you control? And if so, for what users? Or is it something that someone spun up on a credit card to try and test something?

Can the solution detect misplaced PII, whether it’s in the form of email addresses, or social security numbers, or credit card numbers? If so, can they tell you if that repository or location is accessible from the internet?

The fact is you’ll need answers to the questions above to go back and find the root cause and fix these problems today as well as reducing the chances of them happening tomorrow. At Orca, we help you understand the magnitude of the issue and how to ultimately solve the problem. Orca provides recommendations for corrective actions so security teams can expertly harden cloud environments and strengthen their security posture.

Orca not only provides the information to remediate the issue, but also gets it into the hands of the team member(s) that can actually fix the problem. Orca then closes the loop by providing visibility into remediations, notifying the IT operations team as issues are resolved so they can track their successes and turn their attention to other tasks. 

Orca’s integration with Azure Sentinel Security Center and ServiceNow makes the solution far more valuable for BeyondTrust. It uses Security Center like a SIEM, so Orca’s findings pour right into Azure Sentinel Security Center. Orca Security can kick off a ticket in ServiceNow if an investigation or remediation is needed.

“We stood up integrations with Azure Sentinel Security Center and ServiceNow in less than a week, and it works flawlessly. One dashboard chart tells me time-to-triage from the moment Orca detects something. Our average time-to-resolution has been cut in half for anything critical. Once a ticket is closed, and Orca doesn’t see the issue anymore, we have a closed-loop, which is important for our governance team and the people who must ensure we meet our SLAs.” 

Morey Haber
CTO | CISO
BeyondTrust

7 What integrations do you have today and what is the maturity of those integrations? 

The cloud is about openness, and Orca is cloud-native in that regard. This means that authorized technology partners and customers can retrieve data or invoke operations via our public API. The same API that powers the Orca dashboard is open to you. Orca swims nicely with others as shown by our ever-expanding ecosystem of technology partners.

 

But just as important as the number of integrations is the quality and depth. As just one example, Orca has bi-directional sync with Jira that allows our customers to kick-off automated workflows that:

  • Include the precise path to remediation
  • Confirms the issue has been resolved
  • Maintains evidence for auditors

The flexible Orca-Jira configuration interface can even support custom workflows.


 

“Knowing the tasks and associated risks at any moment, we can prioritize what we
send to DevOps so they don’t get overwhelmed. To assign the work, we simply click
the ‘send-to-Jira’ button. If we get audited, we can show, ‘This is our pipeline, this is
our work plan.’ It’s all in Jira and everything has an audit trail. It just becomes very
simple to demonstrate patching and compliance.”

Nir Rothenberg
CISO
Rapyd

 

Connect your first cloud account in minutes and see for yourself.
Scroll to Top

Download our eBook