How to set up a no internet access VLAN for IP Cameras

This is my setup currently: network diagram

Hardware:

• Server is a Asrock N100DC-ITX with 8GB RAM and a Gigabit Intel NIC in the PCIe slot

• Switch is a TP-Link TL-SG1016PE

• Camera is a Hikvision DS-IPC-T14HV3-LA

Software:
I'm running Ubuntu 22.04.3 on the server with Frigate running on a docker container.

My objective is to make sure the camera cannot access the internet.

I created 2 VLANs in the switch:

• VLAN1 with the ports to which router, my PC and the server NIC1 are connected

• VLAN2 with the ports to which the server's NIC2 and the IP Camera are connected

Everything works before I create the the VLANs. The moment I create the VLANs frigate stops showing a video feed. I am no longer able to access the RTSP stream of the camera from the server.
I tried setting the IP addresses of the Camera and server explicitly in the network settings, but still no luck.

What mistake am I making? I went through the settings available on my switch and it doesn't have any way to set individual IPs for individual ports/mac addresses or to setup rules for incoming/outgoing traffic. It was marketed as a "Easy Smart PoE switch". Did I get the wrong kind of switch?

Any help would be much appreciated.