Adam Wilson, CEO of San Francisco-based software firm Trifacta, has said federal agencies should adopt data wrangling platforms and techniques in order to expedite analysis of big data workloads.
Wilson wrote that such tools are designed to help agencies deal with a range of complex information and allow analysts to work directly with the available data.
He described data wrangling as a process used to convert raw data into usable format for analysis and discussed how the process helped the Center for Disease Control and Prevention determine the cause of an HIV/AIDS outbreak in Indiana in 2015.
The use of data wrangling platforms could assist agencies in the detection of fraud and other cyber threats through merger and standardization of “a diverse set of user, system, and application data that allow them to more quickly identify suspicious behavior, †Wilson noted.
He cited that data wrangling systems work to help government agencies leverage the use of geospatial data and weather information to devise evacuation plans during natural disasters.
The adoption of such tools could also help military agencies perform predictive maintenance and repair of ships and aircraft by combining sensor-based data with historical maintenance records, Wilson added.
