Close
Josh Lefkowitz
Chief Executive Officer
Josh Lefkowitz executes the company’s strategic vision to empower organizations with Business Risk Intelligence (BRI). He has worked extensively with authorities to track and analyze terrorist groups. Mr. Lefkowitz also served as a consultant to the FBI’s senior management team and worked for a top tier, global investment bank. Mr. Lefkowitz holds an MBA from Harvard University and a BA from Williams College.
Evan Kohlmann
Chief Innovation Officer
Evan Kohlmann focuses on product innovation at Flashpoint where he leverages fifteen years’ experience tracking Al-Qaida, ISIS, and other terrorist groups. He has consulted for the US Department of Defense, the US Department of Justice, the Australian Federal Police, and Scotland Yard’s Counter Terrorism Command, among others. Mr. Kohlmann holds a JD from the Univ. of Pennsylvania Law School and a BSFS in International Politics from the Walsh School of Foreign Service at Georgetown Univ.
Josh Devon
Chief Operating Officer / VP Product
Josh Devon focuses on product vision and strategy at Flashpoint while ensuring the company’s departments function synergistically during its rapid growth. He also works to ensure that customers receive best in class products, services, and support. Previously, Mr. Devon co-founded the SITE Intelligence Group where he served as Assistant Director. He holds an MA from SAIS at Johns Hopkins Univ. At the Univ. of Pennsylvania, he received a BS in Economics from the Wharton School and a BA in English from the College of Arts and Sciences.
Jennifer Leggio
Chief Marketing Officer / VP Operations
Jennifer Leggio is responsible for Flashpoint’s marketing, customer acquisition, and operations. Ms. Leggio has more than 20 years of experience driving marketing, communications and go-to-market strategies in the cybersecurity industry. She’s previously held senior leadership roles at Digital Shadows, Cisco, Sourcefire, and Fortinet. She’s been a contributor to Forbes and ZDNet, and has spoken on the importance of coordinated disclosure at DEF CON and Hack in the Box, and on threat actor “publicity” trends at RSA Conference, Gartner Security Summit, and SXSW Interactive.
Chris Camacho
Chief Strategy Officer
Chris Camacho leads the company’s client engagement and development team, which includes customer success, business development, strategic integrations and the FPCollab sharing community. With over 15 years of cybersecurity leadership experience, he has spearheaded initiatives across Operational Strategy, Incident Response, Threat Management, and Security Operations to ensure cyber risk postures align with business goals. Most recently as a Senior Vice President of Information Security at Bank of America, Mr. Camacho was responsible for overseeing the Threat Management Program. An entrepreneur, Mr. Camacho also serves as CEO for NinjaJobs: a career-matching community for elite cybersecurity talent. He has a BS in Decision Sciences & Management of Information Systems from George Mason University.
Lisa Iadanza
Chief People Officer
Lisa M. Iadanza leads all functional areas of People Operations at Flashpoint, including human resources, talent acquisition & management, employee engagement, and developing high performance teams. In addition to collaborating with the executive team to drive strategic growth, she plays an integral role in fostering Flashpoint’s culture and mission. Driven by her passions for mentorship, employee advocacy, and talent development, Ms. Iadanza has more than twenty years of experience in building, scaling, and leading human resources functions. Prior to Flashpoint, she held leadership roles at Conde Nast, Terra Technology, and FreeWheel. She is a member of the Society for Human Resources Management (SHRM) and holds a bachelor’s degree in management with concentrations in human resources and marketing from State University of New York at Binghamton.
Rob Reznick
VP of Finance and Corporate Development
Rob Reznick leads the finance, accounting, and corporate development teams at Flashpoint. Rob previously served as Director of Finance & Accounting for 1010data (acquired by Advance/Newhouse), and Director of Finance for Financial Guard (acquired by Legg Mason) after prior work in forensic accounting and dispute consulting. Mr. Reznick is a Certified Public Accountant and holds an MBA and MAcc from the Fisher College of Business at the Ohio State University, and a BBA from the Ross School of Business at the University of Michigan.
Lance James
Chief Scientist / VP Engineering
Lance James is responsible for leading Flashpoint’s technology development. Prior to joining Flashpoint in 2015, he was the Head of Cyber Intelligence at Deloitte & Touche LLP. Mr. James has been an active member of the security community for over 20 years and enjoys working creatively together with technology teams to design and develop impactful solutions that disrupt online threats.
Brian Costello
SVP Global Sales and Solution Architecture
Brian Costello, a 20-year information technology and security solutions veteran, is responsible for leading the Global Sales, Solution Architecture, and Professional Services teams at Flashpoint. Throughout his career, Brian has successfully built security and cloud teams that have provided customers with innovative technology solutions, exceeded targets and consistently grown business year over year. Prior to Flashpoint, Brian led a global security and cloud vertical practice for Verizon. Brian also held senior leadership roles at Invincea, Risk Analytics and Cybertrust. Brian received his B.A. from George Mason University.
Tom Hofmann
VP Intelligence
Tom Hofmann leads the intelligence directorate that is responsible for the collection, analysis, production, and dissemination of Deep and Dark Web data. He works closely with clients to prioritize their intelligence requirements and ensures internal Flashpoint operations are aligned to those needs. Mr. Hofmann has been at the forefront of cyber intelligence operations in the commercial, government, and military sectors, and is renowned for his ability to drive effective intelligence operations to support offensive and defensive network operations.
Jake Wells
VP, Client Engagement & Development
Jake Wells leads strategic integrations and information sharing as part of the client engagement & development team, which serves as an internal advocate for our government and commercial clients to ensure Flashpoint’s intelligence solutions meet their evolving needs. He leverages a decade of experience running cyber and counterterrorism investigations, most recently with the NYPD Intelligence Bureau, to maximize the value customers generate from our products and services. Mr. Wells holds an MA from Columbia University and a BA from Emory University.
Brian Brown
VP Business Development
Brian Brown is responsible for the overall direction of strategic sales and development supporting Flashpoint’s largest clients. In his role, Mr. Brown focuses on designing and executing growth-oriented sales penetration strategies across multiple vertical markets, including both Government and Commercial, supporting Flashpoint’s Sales and Business Development Teams. An experienced entrepreneur, Mr. Brown also serves as CSO for NinjaJobs, a private community created to match elite cybersecurity talent with top tier global jobs and also advise growth-stage cybersecurity companies.
Close
Steve Leightell
Steve started his career in Internet sales in the early 1990s and was always a top sales rep before transitioning to business development. By the early 2000s, he was the Director of Business Development at DWL, where he managed a team that built partnerships with Accenture, Oracle, Tata Consulting, Wipro, Cognizant and IBM. Steve designed the channel and strategy that ultimately culminated in the acquisition of DWL by IBM in 2005. He went on to lead a global team within IBM that was responsible for major system integrator partnerships. In 2008, he left IBM to found a niche consulting firm focused on business development for SaaS organizations. Steve holds a BA in anthropology and sociology from Carleton University in Ottawa.
Ellie Wheeler
Ellie Wheeler is a Partner at Greycroft and is based in the firm’s New York office. Prior to joining Greycroft, Ellie worked in a similar role evaluating investment opportunities at Lowercase Capital. Ellie also worked at Cisco in Corporate Development doing acquisitions, investments, and strategy within the unified communications, enterprise software, mobile, and video sectors. While at Cisco, she was involved in multiple acquisitions and investments, including PostPath, Jabber, Xobni, and Tandberg. She began her career in growth capital private equity at Summit Partners in Boston. Ellie graduated magna cum laude from Georgetown University with a BA in Psychology and holds an MBA from Harvard Business School.
Glenn McGonnigle
Glenn McGonnigle is a General Partner at TechOperators. Prior to launching TechOperators in 2008, Glenn was CEO of VistaScape Security Systems, a venture-backed provider of enterprise intelligent video surveillance software. He lead the company through its successful sale to Siemens Building Technologies. Previously, Glenn was a co-founder and senior executive of Atlanta-based Internet Security Systems (ISS) where he helped raise initial venture capital and launch the business. For 7 years, he led the business development team in developing sales channels and entering the managed security services market. During his tenure, the company grew from startup to revenues of over $225 million and was later acquired by IBM for $1.3 billion.
Peter George
Peter George has an established track record of building companies that deliver sustained growth and profits and in identifying critical worldwide partnership opportunities that strategically expand market share. Prior to becoming President and CEO of Fidelis Security Systems in 2008, Mr. George spent the last seven years as President and CEO of Crossbeam Systems, the market leader in the high-end segment of the Unified Threat Management market, where he took the company from being a pre-revenue start-up to over $50 million in revenue. Previously, he was President of Nortel Networks Enterprise Business in Europe, Middle-East, and Africa, responsible for managing more than 5,000 employees and $2 billion in revenue. Mr. George came to Nortel via their 1998 acquisition of Bay Networks where he was serving as vice president of European operations. During his tenure at Wellfleet and Bay, he played key sales executive roles in New England and in Europe. Prior to joining Wellfleet, Mr. George served as the Northeast regional manager and GM of Canada at 3Com Corporation, and also held senior management positions at Ungerman Bass. He received his BA from the College of the Holy Cross, and has done graduate studies at Harvard and Oxford University.
Brendan Hannigan
Brendan joined Polaris Partners in 2016 as an entrepreneur partner. In this role, he focuses on funding and founding companies in the technology sector with a concentration in cloud, analytics, and cybersecurity. Brendan is a co-founder of Sonrai Security and chairman of Twistlock, both Polaris investments. He also currently serves on the board of Bitsight Technologies and Flashpoint. A 25 year technology industry veteran, Brendan was most recently the general manager of IBM Security. Under Brendan’s leadership, IBM Security grew significantly faster than the overall security market to become the number one enterprise security provider in the world with almost $2B of annual revenue.
image/svg+xml image/svg+xml
The Flashpoint Add-on for Splunk, which facilitates the delivery of Flashpoint technical data and associated context is now available. Learn More

Ensure Measurements of Your Intelligence Program Don’t Prioritize Vanity Metrics

Blog
December 12, 2018

Vanity metrics get a bad rap—and most of the time, deservedly so. While their usage is often relegated to data analytics and digital marketing teams, they can also infiltrate intelligence programs with measurements of things often purporting to be key performance indicators (KPIs) that instead lack a true context that would better give them value.

As their name implies, vanity metrics are measurements that look good on paper and appear to indicate solid performance or value, but are in reality, deceptive and trivial.

Many KPIs used to evaluate intelligence programs are vanity metrics masquerading as KPIs. Measurements such as the number of intelligence reports an organization produces, the number of indicators of compromise (IoCs) processed, data points collected, or keyword alerts received, don’t accurately indicate performance.

Relying on these types of vanity metrics may distort your perception of how well an intelligence operation is running. If a financial organization is hoping to reduce losses due to fraud, for example, it may measure its progress by tracking the number of data points collected to support the operation. While a large, or larger-than-average, number of data points collected would look good on paper and might even suggest increased collections efficiency, it would not definitively indicate that the operation was successful in achieving its objective of reducing fraud losses.

Rather, you would need to choose KPIs that 1) map to the operation’s requirements and objectives; 2) can feasibly measure at scale; and 3) will help identify any blind spots or areas for improvement that could arise. The right KPIs for this operation might include:

• Number of emerging fraud schemes identified

• Number of new anti-fraud measures informed

• Number of fraud attempts that were prevented versus the number that were successful

• Relative reduction in fraud losses

Vanity metrics may also distort an organization’s perception of value; this is especially applicable with respect to vendor offerings. Many intelligence programs obtain the data, intelligence, and tools on which their operations rely from third-party vendors, but choosing the right vendor may be difficult given the abundance of misleading claims in the market—many of which are fueled by vanity metrics.

Collection strategies are perhaps the biggest differentiator among intelligence vendors. But because many intelligence consumers and decision-makers aren’t always aware of exactly which types of data and sources are best suited for their operations, they often—and understandably—assume that more is better. This assumption is largely why many vendors choose to highlight the following vanity metrics in order to differentiate their offerings:

• Number of data sources

• Number of total data points

• Number of new data points points collected per day

• Number of customers

But similar to how web page views aren’t indicative of website performance (compared to other measurements such as active users and engagement), vanity metrics aren’t indicative of the extent to which an intelligence offering is suitable to a program’s needs and objectives. It’s crucial to remember that regardless of how they are marketed or perceived, the quantitative aspects of a vendor’s collection strategy do not reflect the qualitative aspects.

This same principle also applies to your operational KPIs. In other words, there’s no point in having billions of data points if those data points aren’t timely, accurate, actionable, and adequately map to your intelligence objectives and requirements.

avatar

Josh Lefkowitz

CEO

Josh Lefkowitz is the Chief Executive Officer of Flashpoint, where he executes the company’s strategic vision to empower organizations with Business Risk Intelligence (BRI) derived from the Deep & Dark Web. He has worked extensively with authorities to track and analyze terrorist groups. Mr. Lefkowitz also served as a consultant to the FBI’s senior management team and worked for a top tier, global investment bank. Mr. Lefkowitz holds an MBA from Harvard University and a BA from Williams College.

Flashpoint Intelligence Brief

Subscribe to our newsletter to stay up-to-date on our latest research, news, and events