Data on real estate transactions, transportation and logistics are almost always public records but difficult to gather unilaterally. Much of it can be obtained from commercial sectors on a subscription basis.
When it comes to gathering information about individuals, the draft notes, “Fortunately, penetration of social media, preponderance of publicly available Personal Identifying information databases and sources, and advancements in available analytical tools significantly improve the ability to rapidly and accurately do human entity resolution from open sources.”
The Department of Energy’s Special Technologies Laboratory was the developer of the Raptor X open architecture.
Creative Radicals, a San Francisco design and development firm, created Social Bubble, the Twitter search tool that “was heavily used to explore human networks associated with the counter-finance threat scenario and enabled identification of various entities: people, businesses and locations associated with the money laundering network,” according to the draft.
Red Cell Intelligence Group of Arlington specialized in collecting data from public or commercial sources to create a searchable database of international banking relationships; Green Line System is a commercial maritime tracking and analysis company and in Quantum Leap “demonstrated the ability to track a particular ship or ships associated with a named company,” the draft said.
One of the major lessons learned was the “pronounced utility of social media in exploiting human networks, including networks in which individual members actively seek to limit their exposure to the Internet and social media,” the draft report said.
Among other lessons:
●Location-based services are becoming prevalent and much more accepted in social media by the younger generation.
●Exploiting social media could become more or less difficult in the coming months, depending on whether security methods improve.
●Legal reviews of the uses and applications of social media are just beginning and inevitably will transform notions of privacy.
A data revolution is underway with private industry and government leading the way. But as the response to the NSA disclosures show, this country is not yet prepared for it.