I am in the process of building an infrastructure for my gitlab instance using AWS EKS. I have already created an EKS cluster, added a managed node group and installed the gitlab-runner in the cluster. In this node group I can now run my pipelines as usual. In my gitlab instance, I have several projects that each have an MR pipeline. In addition, I run another pipeline overnight in each project. These pipelines that run overnight sometimes require certain HW resources such as an FPGA board or an SDR. I want to clarify that I don't want to build and deploy apps in my cluster. The cluster should be used exclusively to run the pipelines.
Currently I am trying to create the right setup for the node groups and would like to draw on community experience in this regard.
What do I want to achieve?
I want to be able to determine the HW for the individual jobs, such as building the code. It should be possible to speed up the process with more nodes or a stronger instance type.
I also want to have a node group for external resources with special HW (FPGA boards, SDRs) to use in my tests.
Questions:
- What node groups and settings are suitable in your experience?
- How to run jobs in single node groups via gitlab? Is this possible with tags? How do I address the individual groups in gitlab?
- What is the best way to manage external HW resources, like the ones in my local lab?
I would be very happy if you share your experiences with me! Every help is appreciated! Thanks a lot!
Cheers!
ninjab3s