Move Over Data Warehouses, Here Come Data Lakes

Move Over Data Warehouses, Here Come Data Lakes

Move Over Data Warehouses, Here Come Data Lakes 

The role of data analytics is quickly expanding in the public sector. How the Government will get their arms around the vast amounts of data, however, continues to be a challenge. While data-driven decision making is the future, the Government needs reliable ways to access the data and turn it into information.

So, what does the future of Government analytics look like? The answer may reside in the shift from data warehouses to data lakes. A data lake is a storage repository that holds large amounts of raw, natural, unstructured data. The concept places all the collected data in one large lake, allowing Government agencies to determine how much data to pull out in a specified filter and structure. This differs from a data warehouse, where data is often structured in files or folders, and accessed through customized reports.

Data lakes allow agencies to plan for scalability, reduce managing costs, and remove silos. In a data lake environment, analysts dictate the types of analysis because static data warehouses, predetermined filters/fields, or data models do not limit them. When data is raw or undefined, analysts can make their own connections to drive the analysis.

Data lakes also prevent datasets from becoming outdated or disconnected. While some data elements may not be useful for today’s analytics, they could be in the future. Data lakes help create an environment that allows the Government to constantly connect data from different time periods and different sources to solve current and future issues.

As the amount of gathered data continues to grow and change, the Government must reexamine how to best structure its analytical platforms to meet the current challenges facing our country. Data lakes improve scalability, remove silos, and have the flexibility to meet unforeseen future challenges. As a result, they could offer a unique alternative as the future of Government analytics evolves.

Blog Data Analytics

Contributors

Nick Rodriguez |

Nick joins Arc Aspicio after years of working with alongside various federal and local law enforcements providing analytical support covering various topics. Nick has a Master’s degree from Boston University in Criminal Justice and a BA in International Criminal Justice from John Jay College of Criminal Justice. Nick’s background includes providing project assistance with analytical tools such as Palantir and Esri. 

Mr. Roboto: Your Newest Coworker

Mr. Roboto: Your Newest Coworker

Could your next cubemate be a robot? Elon Musk, the Tesla and SpaceX founder, is building our future coworkers and forming a world filled with Artificial Intelligence (AI) that could “beat us in just about everything,” including our jobs. As Musk attempts to create a real-life iRobot, many advantages and a possible partnership arise with this future. How can the Government and Homeland Security prepare and welcome new technological advancements?

Data + Strategy: Using Data to Inform Agency Strategy

Data + Strategy: Using Data to Inform Agency Strategy

Understanding the types of data available, gaining access to the right data, and making sense of data are daunting tasks for most organizations as they develop a strategy to meet mission demands and enterprise-wide goals. Data is especially challenging for the Government, yet provides the opportunity for insight for leaders as they strategically move their agencies forward.

Workplace Morale is Going to the Dogs… Literally!

Workplace Morale is Going to the Dogs… Literally!

There are few greater feelings than a dog’s unconditional love. And some are finding that a dog’s love can help combat stress at work. Secretary Zinke of the Interior Department announced his intent for "Doggy Days" where he encouraged employees to bring their canine companions to work on designated days. More than 80 dogs arrived for first event and the overjoyed employees immediately scheduled the next.

Accelerating FITARA Compliance: Five Steps That Leaders Can Take Today

Accelerating FITARA Compliance: Five Steps That Leaders Can Take Today

Implementing change is not always easy, but it is always necessary. Federal agencies have been working to transform how they acquire and manage Federal information technology (IT). The Federal Information Technology Acquisition Reform Act (FITARA) in December 2014 has increased visibility into this transformation.Although FITARA enhances the authority and accountability of Chief Information Officers (CIOs) in reviewing and approving major IT investment projects, CIOs continue to look for new ways to implement best practices at their agencies.

Combating the Rise of Transnational Criminal Organizations

Combating the Rise of Transnational Criminal Organizations

Crime, corruption, and violence – particularly involving drug, human, and weapons trafficking – continue to increase at an alarming rate in the U.S. Transnational Criminal Organizations (TCOs) are a critical part of this trend and pose a serious and growing threat to homeland security – at our borders and beyond.U.S. Customs and Border Protection (CBP) is at the tip of the spear to combat TCOs. With the context that the first goal in their Vision and Strategy 2020 Strategic Plan is Counter Terrorism and Transnational Crime, CBP is focusing on disrupting TCOs responsible for the cross-border trafficking of illegal drugs, humans, and guns.

Design Thinking: Putting the Citizen at the Heart of Lasting Change

Design Thinking: Putting the Citizen at the Heart of Lasting Change

For the past few decades, there has been a growing increase in the digital channels available to network with the Federal government. These channels have made it easier for the public to interact and elicit responses from elected officials.These growing interactions have increased expectations for Government to be more transparent and collaborative. From the Department of Homeland Security (DHS) to the Department of State (DOS), Design Thinking transformations have begun to develop and modernize programs to be more human-centered. Agencies and programs beholden to serve the public good should logically adopt a problem-solving mindset that places the individual at the heart of any lasting changes.

Using Behavioral Science to Improve Mission Outcomes

Using Behavioral Science to Improve Mission Outcomes

Although behavioral science has been studied and applied within academia for decades, recently the concept has emerged everywhere – from Silicon Valley tech giants such as Google and Uber, to various Government agencies including the Department of Education, the Department of Defense, and the Department of Agriculture.But defining and applying such a broad and sometimes-nebulous discipline can prove difficult. What exactly is behavioral science? How can the Government use the concepts and lessons learned effectively?

Crowdsourcing to Improve Security

Crowdsourcing to Improve Security

Many of us are familiar with the idea of crowdsourcing. Corporations and the Government both use crowdsourcing to generate data, raise awareness campaigns, and produce ideas. So, what if we used crowdsourcing to enhance our security and bridge communication gaps between the Government and American citizens at the same time?

Homeland Security Managers = Innovative Leaders

Homeland Security Managers = Innovative Leaders

The search for and implementation of innovative methods to protect the homeland should play an important role in homeland security managers’ approach to how they guide their organizations. Citizens expect government leaders to propose and implement organizational, acquisition, and personnel management practices that enhance our nation’s ability to prepare for and mitigate potential threats. They expect these to make them safer and the nation more secure.