Data Science has become an umbrella category for a number of roles. It is being increasingly recognised that the ‘unicorn’ data scientist who is a master of all the in-demand skills is largely a myth, and that data science roles need to be further specified to serve business needs.

Unfortunately, job titles are still sometimes used inconsistently, which can be confusing if you are looking to pursue a new direction or find a new job. Here is a quick and handy guide to the top job roles, and a breakdown of what each one involves.

Data Scientist

This is probably the most common overarching job title. A data scientist’s core responsibility will be to provide actionable business insight from a dataset. Stitch Fix’s Director of data science, Michael Hochster, suggests that the roles tend to fall into two camps: analytical or building. The first focuses on the statistical interpretation of data, whereas the latter builds models based on data. The extent you’ll be expected to diversify your talents will depend on the structure and size of the data science team (i.e. your role is likely to become more focused on true data science in a larger team). Regardless, a data scientist will need to be comfortable with a range of machine learning and data mining techniques. Key skills include expertise in programming languages such as R, MatLab, SQL and Python and a strong background in computer science or related field.

Business analyst / Data Journalist / Data Translator

These titles refer to a number of related roles which all focus on communicating data insights and putting them in context of the wider business goals. People in these roles will need a talent for creating a data story and presenting it to people without data expertise or even without much IT knowledge. The focus will be on understanding how data trends can be leveraged to drive the business forward, whereas a data scientist may want to know the root cause of such trends. Though a statistical and coding knowledge are important, it is communication, a business background and an in-depth industry knowledge that are the key skills to these roles.

Data Analyst / Statistician 

Now, an analyst and a statistician may rely on similar methods to analyse datasets, but they are very different roles. Harvard Business Review describe the difference as a narrow and deep approach (statisticians) vs wide and shallow (analysts). Statisticians can estimate how data insights might hold up in a variety of circumstances by incorporating error into a model — so they are useful for in-depth insights and minimising the risk of reaching an incorrect conclusion. On the other hand, a data analyst can code at lightning speed and discover potential insights extremely quickly — they can then point statisticians in the right direction. Utilising both a statistician and an analyst can make for a highly efficient system.

Data Engineer / machine learning engineer

Engineering roles often fall under data science (and these roles can often be combined), but when there is a specific engineering role, these people are likely to work with data at an early stage. As a data engineer, you will build and optimise data and data pipeline architecture. Think of engineering as creating the infrastructure necessary for further analysis. As a result, a technical computer science background and exemplary coding skills are essential to this role. It will also be an advantage to gain experience with big data tools, SQL and NoSQL databases, data pipeline tools and cloud services. Machine learning engineering is an additional specialism, which focuses on identifying and applying appropriate models to big datasets.

Data Architect / Data Administrator / Data Manager

Big data just keeps growing, and in response many companies are hiring specialists to manage these large datasets. If you are working in one of these roles, you will be expected to create systems that enable integration, centralisation and protection of datasets. You ensure the data engineers and data scientists have an efficient dataset to work with, that it is safely backed up and can be easily recovered. Therefore, you will need to be comfortable in data modelling techniques, data warehousing and security procedures.
 

QA testing is an evolving world. Digital transformation means there’s more demand than ever for high-quality software to be delivered at record speed. In addition, QA professionals are being asked to adapt to Agile and/or DevOps approaches, take an interest in AI and automation, all while working from home. It’s a lot to keep up with, so here are the web’s favourite resources to help on your QA journey.

Test scenario checklist

A testing checklist is an essential tool for any QA tester. Maintaining a checklist of the most useful, reusable test cases means that the most common bugs can be quickly and easily identified. Software Testing Help have provided a master list of 180 (and counting!) test cases applicable to a variety of web and desktop applications. Test scenarios include those for GUI and usability, filter criteria, result grid, a window, database testing, image upload functionality, sending emails, export functionality, performance, security and other more general functions. They recommended you continue to build a checklist tailored to your own needs, but this will save you lots of time getting started.

Real-world examples

The Google Testing Blog is a QA gold mine of expertise. Each article deals with a topical issue or new challenge encountered by the Google testing team and provides a breakdown of how the problem was dealt with, clearly communicated with screengrabs, diagrams and infographics. Recent articles have covered Test Flakiness - One of the main challenges of automated testing and Fixing a Test Hourglass. Keeping up with this blog is a sure-fire way to expand your QA knowledge.

API automation workshop

A recent TechBeacon article highlighted the need for more API-level tests — but many testers lack experience in this area, being more familiar with GUI-based automation. Bas Dijkstra offers an API workshop focusing on REST (which most modern APIs are developed by). This free workshop, hosted on Github, covers RESTful APIs, REST Assured and provides hands-on exercises to get you up to speed. It’s a great resource that has been well received by the testing community.

Community

StickyMinds is an active community of software testers. Signing up gets you access to a large archive of the Better Software magazine, more than a decade of TechWell conference presentations and regular articles on what’s new in software testing. Best of all, there’s a lively Q&A forum where you can ask questions about best practices, industry hot topics and more. It’s free to join but, as with most online communities, you’ll get out what you put in.

Comprehensive skills boost

If you’re looking to boost your testing skills, then Nikolay Advolodkin’s site, Ultimate QA, might be just what you’re looking for. It offers a combination of paid (but not expensive) and free courses covering all aspects of QA testing. Popular courses include Complete Selenium WebDriver with Java Bootcamp and Selenium WebDriver Masterclass with C#. Ultimate QA also provides a number of articles and resources — their collection of websites to practice automation is a particularly useful one you’ll want to bookmark straight away.

Bug tracking systems

QA testing revolves around a cycle of finding, reporting and tracking bugs (anything that stops software operating correctly). Spreadsheets and emails quickly become inefficient to manage larger projects, so you will need to turn to a bug tracking software — a good one will save you countless hours and make communication across teams much easier. Software Testing Help provides a fantastic breakdown of the best bug tracking options. Their recommendations include Airbrake, which is the most popular bug tracking software with over 50,000 users, and Mantis, which is free and one of the most easy-to-use systems.
 

Diversity remains a key issue for the technology industry. According to a recent BCS report, 18% of IT professionals have BAME backgrounds. BAME people are also less likely to hold senior positions — only 9% are directors and 32% are supervisors (for comparison 43% of white employees have a supervisory role). The lack of diversity becomes even clearer when considering specific ethnic groups. For example, black women make up just 0.7% of the technology industry — a representation rate that is 2.5 times lower than in other industries. Clearly, the technology industry is still struggling to achieve true diversity, so what can companies do about it? 

Set targets

It’s easy to say the right thing, harder to put this into action. Setting targets, continually measuring diversity and reviewing progress helps organisations to commit to change. For example, some big companies like Facebook and Pinterest have tried to use the ‘Rooney rule’ where at least one woman and one person of colour are interviewed for director positions within the company. However, progress has been limited and concerns about it being a ‘diversity tickbox’ exercise have been raised. More recently, it’s been emphasised that targets need to be set at all levels of seniority, and that there needs to be external accountability for failure to meet targets.

Make a stance

On the other hand, sometimes companies fail to say enough. Statements of diversity support are important to attract new staff and ensure existing employees are reassured by an inclusive company culture — both those with BAME backgrounds and beyond. For example, Unilever recently pledged their support for a campaign working to end discrimination against hairstyles associated with racial, ethnic and cultural identities. Given that this kind of discrimination often happens in the workplace, a major employer taking a stance sends out a powerful message.

Outreach

Many people from under-represented groups have concerns that a career in tech is ‘not for them’. This can be reinforced by a lack of people who look like them in senior positions. In addition, some BAME communities prioritise traditional jobs such as medicine, law and finance over technology careers. Companies can participate in outreach in schools and other settings to expand on what a technology career looks like and address concerns someone might have about entering the world of technology. Outreach can help to shed a light on available opportunities while also sending a clear message about the company’s commitment to a diverse workforce.

Training

There’s been a recent discussion about diversity training — particularly the low reliability of the implicit association test and its lack of impact on reducing real-world biases — to the extent that the civil service has stopped all unconscious bias training. However, while certain tools have been criticised, research shows that ongoing diversity training is successful when it combines a range of techniques and is complemented by other diversity initiatives. It’s clear that diversity training needs to be ongoing and not seen as a substitute for wider policy change.

Seek external advice

After the Black Lives Matter movement put the spotlight on diversity in 2020, many companies turned to their staff for advice. There have been several instances of people from BAME backgrounds being asked to speak about and advise on diversity practices amidst a climate of emotional trauma and, in some cases, fear of later reprisals from the organisation they were asked to defend. It’s important not to place the burden of improving diversity on individuals — especially if they are unsure how to refuse and are not being compensated for their extra work. Diversity — like any other organisational strategy — should be managed by qualified professionals and engaged with by interested employees.

The technology industry’s track record when it comes to diversity is far from perfect. However, changes are being made. It’s clear that actionable, long-term strategies are needed to truly support organisational diversity in tech.

The Pandemic has accelerated digital transformation. A recent report suggested that the overwhelming majority of UK enterprise decision makers believe COVID-19 has increased their budget for and speed of digital transformation plans. From utilising artificial intelligence to increased reliance on blockchain, organisations are undergoing radical change to stay competitive in the post COVID-19 landscape.

Rapid change from external pressures can lead to incredible innovation, but it can also result in costly errors. In 2018, research by CISQ identified that software errors cost organisations in the US $2.8 trillion. Software issues can lead to security breaches, poor customer experience and wasted time trying to fix problems after deployment.

So, how can organisations avoid the riskier aspects of digital transformation? DevOps — an approach that integrates all stages of design, development and IT processes — is the ideal solution. DevOps and digital transformation go hand in hand. Many large-scale companies are now relying heavily on a DevOps approach, including Starbucks, BMW, Disney, Verizon and Adidas.

But why does DevOps provide such value to organisations? Let’s find out…

Efficiency

One of the most important things a DevOps approach achieves is breaking down the barriers between teams. Frequent feedback in developmental stages means that issues can be identified quickly and early. This means that small problems are usually resolved before they become big problems. It also results in far less time being wasted in developing technologies that are not fit for the purpose.

This increased efficiency is reflected by how much faster DevOps teams operate. A recent analysis by BCG shows that deployment time is reduced by up to 90%. In addition, the quality of the work increases (change failure rate is reduced by 50-70%) while overall IT costs are reduced (15-25%).

Culture

‘Don’t worry, operations will fix it.’ Not with DevOps. Developments tend to utilise a shared code base, frequent testing and automated deploys which enable the team to work together throughout the process. At no stage is the code ‘passed over’ to a separate team, meaning that everyone is responsible for the end product.

This shared responsibility results in both the obvious efficiency and quality benefits, but also a number of cultural benefits. DevOps supports a culture of collaboration, skill sharing and modernity. The shared responsibility also reduces fear of failure, which fosters creativity and innovation. Finally, DevOps teams are happier, more engaged and productive.

Automation

Automation and standardisation are integral to successful DevOps. It reduces human error, eliminates many monotonous tasks and increases the consistency of the output. Best practices and solutions can also be more easily shared across teams.

This translates to employees spending 50% less time remediating security issues and 22% less time on unplanned work and rework. Through automation, DevOps achieves stability in an organisation, allowing employees to spend more time creating new features or code.

To summarise, the benefits of DevOps in organisations are clear. Adopting this approach allows organisations to deploy new software more quickly while reducing the risk of costly errors. It’s also key to breaking down barriers between teams, establishing shared responsibility and allowing more time to be spent on creative work (e.g. new features) — all of which are essential to supporting digital transformation within an organisation.

COVID-19 is changing the way we work and live. With the increase of remote working and reliance on screen-time for entertainment and social interaction, the digital industry is said to be booming. The Financial Times reports, “Tech companies are still hiring feverishly as they move to take advantage of a world shifting increasingly to digital as a result of the coronavirus, despite mass lay-offs elsewhere and growing concerns over plummeting global markets.”

Companies with existing online infrastructure are seeing new subscribers, more time spent on digital platforms and increased reliance on e-commerce. According to The Economist, “Alphabet, Google’s parent, saw sales rise by 13% in the first quarter compared with the year before, and profits reached $7bn.”

But will this digital trend last?

Although we expect an eventual return to in-person activities, COVID-19 is expected to have a long term impact on digital engagement. For example, “tech phobia” is commonly cited as a reason why some, particularly those over 65, may avoid new technology. However, with no alternatives, this age group are embracing new technology. In addition, younger family members are taking the time to help them get set-up and familiar with these new apps and services. What this means, going forward, is that mobile and digital offerings will have a much wider audience, beyond tech-savvy customers and digital native millennials.

MckInsey recently highlighted the post-pandemic trends beginning to emerge in China. For example, there has been a 55% increase in customers planning a permanent shift to online grocery shopping and an increase of 3-6% percentage points in overall e-commerce. Once people overcome the initial barriers, this data indicates that customers may permanently switch or significantly increase their use of digital services.

These behavioural changes are being supported by rapid transformation of digital infrastructure. On an individual company level, businesses are investing in digital strategy – for example, Hotel Chocolat recently announced a multi-million pound investment plan. There is larger scale investment from business – Alibaba Cloud will be putting $28 billion into developing their infrastructure over the next three years. Further government support will be available for UK businesses driving innovation and development.

Finally, an internet connection is now essential for information regarding the pandemic and accessing vital goods and services for those self-isolating. The Human Rights Watch have emphasised the importance of achieving equal access to digital services (and particularly a good quality internet connection, which thousands are currently struggling with). It is clear that we can expect further investment in digital infrastructure in our future.

Who will thrive in the post COVID-19 world?

Evidently, those with a strong existing digital service will be well placed to retain their position once the pandemic has subsided. COVID-19 has created a form of ‘digital Darwinism’ according to Mary Meeker, author of the annual Internet Trends Report, whereby businesses with a clear digital strategy will leave behind those without. In a recent report, McKinsey outlined several actions that should be taken to meet customer needs and prepare for the future. These actions include:

Focus on care and concern: prioritise employee needs and the wider community by reaching out and staying true to company values.

Meet your customer needs: adapt or create digital services and models that meet remote and social distancing requirements.

Reimagine the post-COVID-19 world: plan for economic cuts, changes to brick and mortar stores and increased uptake of digital channels.

Build agile capabilities for fluid times: utilise resources such as social media and ‘ear to the ground’ insights to respond to fast-moving customer signals.

It is these companies, who support customers through the crisis by providing efficient digital services, that will retain customer loyalty in the post COVID-19 world. Those who look further ahead, to develop exceptional experiences and utilise developments in infrastructure, will thrive in our digital future.

Working from home has been vital to slow transmission of the coronavirus. However, a new threat has emerged: increased online activity, use of new applications and less secure home networks are opening up individuals and organisations to a host of cyberattacks.

The problem

According to a recent Forbes article, in an analysis of the first 100 days of the COVID-19 crisis security firm Mimecast reported a 33% increase in detected cyberattacks – including spam (+26%), malware (+35%), impersonation (+30%) and blocked URL links (+56%). Certain industries are being particularly targeted, such as healthcare (e.g. The World Health Organisation have reported a fivefold increase in cyberattacks and PPE themed scams have increased) and banking (increased use of online banking presents many opportunities for hackers – such as exploiting new users who may not be familiar with the service).

A recent report from McKinsey highlighted the multitude of potential cybersecurity risks exacerbated by remote working. For example, changes in app-access rights (such as enabling off-site access and lack of multifactor authentication) and use of personal devices or tools (such as a laptop without central control or an unsecured network) increase the opportunities for cyberattacks. While technology was vital to navigate our way through the COVID-19 crisis, rapid adoption of new digital offerings has increased risk. New tools such as video-conferencing have been particularly affected, where an unauthorised person joins a call to steal information or cause disruption. There are also fake tech support scams – increasingly sophisticated attempts to manipulate remote workers (especially those who may be working from home for the first time) with fabricated access and other tech support issues.

The weakest point in any technical system is the person sitting behind the screen. The majority (at least half, according to Trustwave’s 2020 Global Security Report) of cyberattacks occur via social engineering, a psychological manipulation process using tactics such as sending a scam from a trusted source. As always, cyber-criminals know how to target human vulnerabilities, and the number of phishing scams capitalising on our fear of COVID-19 has significantly increased. In addition, we are more likely to fall for a scam when tired or stressed – given the change to working from home, where many are juggling a variety of stressors – we might be even more vulnerable to these kinds of attacks right now.

What can you do?

Given that the person behind the screen represents a security weak-point, they also represent an area of improvement. We will need to learn how to practise good cyber-hygiene, similar to how we adopted thorough hand-washing and social distancing to reduce the risk of the coronavirus.

There are several excellent resources on improving cybersecurity. For example, Siemens have provided their eight top tips for cybersecurity in the home office, including only bringing home essential devices, not mixing personal and business use of devices and ensuring all software is always up to date. The Electronic Frontier Foundation provide more in depth advice on how to spot a phishing scam.

However, while this information is useful, it can be more difficult to establish reliable cyber-security habits. A reported three in four remote workers have yet to receive cybersecurity training, despite the clear increase in risk. More importantly, remote workers are falling for these cyber-attacks. This was recently highlighted by software development company, Gitlab, who found that 1 out of 5 of their own remote-working staff exposed user credentials by replying to a fake phishing message. Regular testing of existing cybersecurity plans in this manner can help to identify areas for improvement.

The future

While cyber-attacks are growing ever more sophisticated, so is cybersecurity. Gamification is one fresh approach to cybersecurity training. Reading through countless tips and the odd video on cybersecurity is unlikely to translate to robust cyber-hygiene habits. However, gamified training results in increased engagement, knowledge and information retention.

Increased investment in cybersecurity may provide us with a host of interesting ideas. Cheltenham Borough Council recently announced plans for a £400 million campus development, situated next door to GCHQ, said to be the ‘Silicon Valley of the UK’. The complex will help to bridge the current skills gap and enhance the UK’s cybersecurity capacity.

Clearly, the coronavirus has highlighted a variety of cybersecurity threats. With remote working expected to continue for the foreseeable future and beyond, it is vital to address current shortcomings in security. Looking forward, the industry is an exciting one, poised for innovation and development.

Times of crisis have often sparked innovation. The Second World War, for example, brought us the forerunner of modern-day computer, advances in radar, the basis of microwaves and mass production of penicillin. COVID-19 is having a similar effect on digital development. Ideas that might have seemed far-fetched (such as the rapid scale-up of online grocery shopping and other e-commerce) are promoted by a crisis-inspired culture of experimentation. Here are five examples of how technology is developing in response to extraordinary demands.

1. Data Analysis Tools

Finding data is easy, understanding it is hard. To this end, the pandemic has inspired several AI tools to help us make sense of the large amount of available information. Data analytics company, Arria NLG, are involved in two projects helping to transform data into an easy-to-understand narrative – the COVID-19 Live Report and the COVID-19 U.S. Tracking Report. AI analysis is also being used by a group of Northwestern University researchers to identify which research will return reliable, usable results that will help aid the search for COVID-19 treatments and vaccines.

2. Blockchain

The power of blockchain was recently demonstrated in a $12 million cross-continent commodity trade transaction of wheat. Usually, a transaction of this kind can take up to a month. However, using dltledgers’s blockchain platform, this was reduced to just five days. More and more businesses are expanding their reliance on blockchain – such as Nestle, who recently extended their use of the IMB Food Trust blockchain platform to their Swedish coffee range. The implications for keeping supply chains running seamlessly – something the coronavirus has highlighted as a serious challenge – are remarkable.

3. Natural Language Processing

With varied applications, such as helping customers navigate online platforms or as efficient medical tools (such as those used by Providence St. Joseph to offer coronavirus-related information), chatbots are proving useful during the pandemic. Chatbots are most commonly used to increase efficiency by answering simple queries, while forwarding more complex requests to a human operator. However, natural language processing, which refers to the deep learning that allows the chatbot to extract meaning from human conversation, improves with increased data. With some custom-made chatbots already proving useful in advanced interactions (such as Replika’s virtual friends, helping some people cope with the effects of social isolation), the uptake in chatbot use may enable the AI underpinning them to become vastly more sophisticated in the years to come.

4. Automation

At their recent virtual event, IBM announced a new range of AI-powered services, designed to support businesses in automating their digital infrastructure. According to Verdict, the new offering will “use automation to detect, diagnose and respond to IT anomalies and will integrate with other products such as those from Slack and Box.” Developments such as these will allow businesses to successfully adapt to a more digital future.

5. Robotics

Many companies have reported that they are looking to increase use of robotics for food service, warehouses and cleaning operations. Blue Ocean Robotics have responded to this increased demand by creating a cleaning robot, able to destroy viruses, bacteria and other harmful microorganisms with concentrated UV-C ultraviolet light. It can sanitise environments such as hospitals, offices, shops and schools without the need for chemicals, meaning that people can be present during the cleaning. Production was quickly accelerated due to coronavirus-related demand, and it now takes less than one day to create a robot. The general public have often been uncomfortable with the idea of robots (and the issue of replacing human jobs with robot labour remains). However, with social distancing likely to be in place throughout 2021, robot labour may become more acceptable, stimulating demand for and development of robotic technology.

This article has showcased a small handful of the exciting innovation occurring during the pandemic. Given that there is expected to be a permanent shift towards use of digital services and practices such as remote working, these developments could have far-reaching implications for the technology industry for years to come.

Our Technology Market Insights Report & Salary Guide 2020 provides the latest insights on the market collated by our Technology Recruitment Teams, and from data collected from surveying our clients and candidates. 

McGregor Boyall are fully committed to addressing the gender imbalance in the UK Technology space. We recently surveyed women working in technology to gauge their views on the current state of play, and to obtain key action points for the market. 

Our England Regions Salary Guide 2019 provides the latest salary data collated by our specialist Recruitment Teams covering:

• Change & Transformation
• Compliance
• Cyber Security
• Data & Analytics
• Digital
• Finance & Audit
• Financial Crime
• HR & Talent Management
• Legal
• Marketing
• Risk
• Senior Technology & Change
• Technology

Our Technology Market Insights Report & Salary Guide 2019 provides the latest insights on the market collated by our Technology Recruitment Teams, and from data collected from surveying our clients and candidates.