Impact of Big Data Era on Open Source Intelligence
Open source intelligence has a long history. As a specialized intelligence, its
earliest and large-scale application can be traced back to the intelligence work of
the United States and Britain before World War II. The BBC Morning Service (BBCM)
established by the United Kingdom in 1939 and the Foreign Broadcast Intelligence
Service (FBIS) established by the United States in 1941 were the first agencies to
carry out open source intelligence collection.
Over the past hundred years,
personnel from many news media, research institutions, and social intelligence
agencies have been engaged in the collection and analysis of various public
information.
Although open source intelligence has a long history, the
advent of the information age, especially the application and popularization of the
Internet, as well as the development of information science and technology, have
brought open source intelligence into a new stage. The rapid development of various
mobile terminals and self-media has also brought about an explosive growth in the
amount of information. The development of big data technology not only greatly
expands the source of intelligence, but also deeply affects the information
collection, information processing, analysis and judgment of open source
intelligence.
In terms of information collection, big data can help us
collect any information related to intelligence needs from massive amounts of data.
In terms of information processing, modern image processing, language
translation and other technologies are used to clean, screen, compare, and classify
the collected information.
In terms of analysis and judgment, intelligent
algorithms and models can help us further discriminate the collected and processed
information, discover its characteristics, and judge the relationship between
massive amounts of information.
Open source intelligence system: the "puzzle maker" in the era of big
data
In the era of big data, we are facing a huge source of
information. Open source data, also known as "wild data", generally refers to data
released on the Internet, including economic statistics and traffic data released by
the government, sales and management data released by legal persons, and behavioral
and social data left by a large number of Internet users.
The development of
technology has promoted the rapid increase of open source data, and at the same
time, it has also provided opportunities for organizations/institutions that
actively mine the value of open source data and seek to obtain or maintain
investigative or analytical advantages.
In the state of increasing open
source data, it is difficult for investigation and analysis organizations to
effectively collect, merge and refine open source intelligence. Smarter
investigation activities need to solve data overload, data credibility, and global
reach.
Open source intelligence systems fully support all phases of an open
source intelligence investigation, including data collection, data analysis, alert
generation and reporting.
The users who are suitable for using the system
include:
1. Customers who have high requirements for information
authenticity but lack of information;
2. Information workers engaged in
information search, mining, screening and research;
3. Professional analysts
and investigators with high data processing pressure and high timeliness in
relational data processing;
4. Customers who use data to accurately reach,
locate and match targets to achieve business cooperation.
Recommended
open source intelligence system
Knowlesys
Intelligence System, a professional open source intelligence monitoring
system, is developed based the world's leading open source intelligence extraction
technology, with the advantages of quick identification and full coverage. It
enables users to monitor the whole Internet, including social media(Twitter,
Facebook, YouTube, Instagram...), traditional websites (Forum, Chat Room, News...)
and dark web in a timely manner.