Despite the turbulent times of 2020 we have continued to see high demand for Data Governance / Data Management / Cloud Professional. Over the past 10 years there has been a huge push for firms to manage their data and it is imperative that they build a strong data governance strategy to ensure they are compliant with any current and future regulations.

With the fast approaching Basel III deadline, it is extremely important that firms have their data processes in order. During these uncertain times it is crucial that firms manage their data correctly and input it accurately, as this will stand firms in a good stead when building crucial new data strategies for the future.

Additionally, Data Analytics remains a top priority for many organisations. Now, more than ever, is the time to utilise the data we have and use it to build a robust strategy for the future.

Data Governance

The importance of Data Governance cannot be underestimated and for firms nowadays their data infrastructure has to be transparent and auditable.

For the data governance to be compliant, there needs to be a robust data infrastructure in place, so that when there are potential moments of crisis all the data processes and infrastructure remain intact. Data governance is the most important element of the data infrastructure, along with the definition of your data strategy and data lineage, to ensure that performance is regularly assessed.

As we know data and risk are intertwined and it is extremely important that your data is of the right quality before any risk calculation is conducted.

Improving data quality is something that cannot be taken for granted. This can be done by ensuring that your data quality is tracked, taking steps to ensure that data is clean at the points of entry and finally utilising automation processes to limit human error and save time.

Cloud

With so many cloud migrations and upgrades, there has been lots of demand for cloud data professionals with AWS, Azure or GCP experience, to assist with a new cloud-based Data management structures within many financial services firms.

With the dramatic increase in remote working in recent months having a robust cloud platform has been essential in ensuring employees can access their data from the cloud and work as they would in the office. 
 
Firms that have utilised these cloud platforms have been able to continue working successfully in these uncertain and unpredictable times.

Data Science/Data Engineering

The continual growth of Data Science/Data Engineering technologies and functions is more important than ever in these challenging times. The UK Government and major organisations around the globe are reliant on intelligent technology, which is underpinned by Data Science. 

Machine Learning and Data Science technologies have allowed for regular data driven updates and advances in Artificial Intelligence have created a robust digital age. Next day deliveries (e.g. Amazon), streaming services (e.g. Netflix) and near real time takeaway services (e.g. Deliveroo) have become the norm during lockdown and they will continue to grow beyond this. 

Organisations have switched to remote working and technological advances have meant that almost anything that previously had to be done in the office can now be done online.

As a result of this, we are expecting to see strong demand for Data Engineers and Data Scientists going forward. The increase in the number of digitally aligned companies means that organisations will require Data Engineers to implement fit for purpose, secure data analytics platforms and they will need Data Scientists to derive insights from the complex data sets. 

It is more important than ever to be able to use data to prepare for potential scenarios and inform our decision making, and candidates who are able to crunch data and turn it into valuable insights and data strategy are going to be in high demand over the course of the next year or so. Advanced Data Science is becoming an essential component of almost every industry in both the public and private sectors. 

Times of crisis have often sparked innovation. The Second World War, for example, brought us the forerunner of modern-day computer, advances in radar, the basis of microwaves and mass production of penicillin. COVID-19 is having a similar effect on digital development. Ideas that might have seemed far-fetched (such as the rapid scale-up of online grocery shopping and other e-commerce) are promoted by a crisis-inspired culture of experimentation. Here are five examples of how technology is developing in response to extraordinary demands.

1. Data Analysis Tools

Finding data is easy, understanding it is hard. To this end, the pandemic has inspired several AI tools to help us make sense of the large amount of available information. Data analytics company, Arria NLG, are involved in two projects helping to transform data into an easy-to-understand narrative – the COVID-19 Live Report and the COVID-19 U.S. Tracking Report. AI analysis is also being used by a group of Northwestern University researchers to identify which research will return reliable, usable results that will help aid the search for COVID-19 treatments and vaccines.

2. Blockchain

The power of blockchain was recently demonstrated in a $12 million cross-continent commodity trade transaction of wheat. Usually, a transaction of this kind can take up to a month. However, using dltledgers’s blockchain platform, this was reduced to just five days. More and more businesses are expanding their reliance on blockchain – such as Nestle, who recently extended their use of the IMB Food Trust blockchain platform to their Swedish coffee range. The implications for keeping supply chains running seamlessly – something the coronavirus has highlighted as a serious challenge – are remarkable.

3. Natural Language Processing

With varied applications, such as helping customers navigate online platforms or as efficient medical tools (such as those used by Providence St. Joseph to offer coronavirus-related information), chatbots are proving useful during the pandemic. Chatbots are most commonly used to increase efficiency by answering simple queries, while forwarding more complex requests to a human operator. However, natural language processing, which refers to the deep learning that allows the chatbot to extract meaning from human conversation, improves with increased data. With some custom-made chatbots already proving useful in advanced interactions (such as Replika’s virtual friends, helping some people cope with the effects of social isolation), the uptake in chatbot use may enable the AI underpinning them to become vastly more sophisticated in the years to come.

4. Automation

At their recent virtual event, IBM announced a new range of AI-powered services, designed to support businesses in automating their digital infrastructure. According to Verdict, the new offering will “use automation to detect, diagnose and respond to IT anomalies and will integrate with other products such as those from Slack and Box.” Developments such as these will allow businesses to successfully adapt to a more digital future.

5. Robotics

Many companies have reported that they are looking to increase use of robotics for food service, warehouses and cleaning operations. Blue Ocean Robotics have responded to this increased demand by creating a cleaning robot, able to destroy viruses, bacteria and other harmful microorganisms with concentrated UV-C ultraviolet light. It can sanitise environments such as hospitals, offices, shops and schools without the need for chemicals, meaning that people can be present during the cleaning. Production was quickly accelerated due to coronavirus-related demand, and it now takes less than one day to create a robot. The general public have often been uncomfortable with the idea of robots (and the issue of replacing human jobs with robot labour remains). However, with social distancing likely to be in place throughout 2021, robot labour may become more acceptable, stimulating demand for and development of robotic technology.

This article has showcased a small handful of the exciting innovation occurring during the pandemic. Given that there is expected to be a permanent shift towards use of digital services and practices such as remote working, these developments could have far-reaching implications for the technology industry for years to come.