Here is a summary of how this feature was implemented.

Getting the API response

In order to handle getting the response status from the API when an error occurs, I made a few changes to the AppView component. First I created two state variables, error and response.

error: This variable contains a boolean. It is set to true if the ok prop of the JSON response is false.
response: This is an object that stores the response code (ex.404) and the status message that is returned. This is also set when the ok prop of the JSON response is false.

I also added an if-else statement to evaluate when the ok prop of the JSON response is true or false. Here is the code diff to show the changes made

+	const [error, setError] = useState(false)
+	const [response, setResponse] = useState({ status: '', message: '' })


//some code...

- setQueues(queueJson);
- setIsLoading(false)
+ if (apiResponse.ok) {
+     setQueues(queueJson);
+     setIsLoading(false)
+ } 
+ else {
+    setResponse({ status: apiResponse.status, message: apiResponse.statusText })
+     setError(true)
+			}

UI

The UI for this is simple. It is a collection of Typography components that display the status code and the message. I then used a ternary to display the error UI when the error state value is true and the ItemTable when it is false. Below is the code and a screenshot of how the UI looks.
Code

{error ? 
<Box classes={{ root: classes.errorContainer }}>
    <Typography variant="h1">
        {response.status}
    </Typography>
    <Typography variant="h3">
        Something went wrong.
    </Typography>
    <Typography variant="h5">
        {response.message}
    </Typography>
</Box>
 : 
<ItemTable data={items} rowCanBeSelected={sidebarOpen} loading={isLoading} />
}

Sceenshot

Finally, in order to implement this UI, the API now has the ability to request error codes for future error testing or handling.