Configurable the daemon resource requirements

[ccojocar]

What type of PR is this?

/kind feature

What this PR does / why we need it:

It makes configurable the daemon resource requirements. This is useful when the daemon requires different resource requirements due to the cluster size (e.g. number of pods is watching for).

Which issue(s) this PR fixes:

Does this PR have test?

Special notes for your reviewer:

Does this PR introduce a user-facing change?

Make the daemon resource requirements configurable.

[ccojocar]

/assign @saschagrunert

[codecov-commenter]

Codecov Report

Merging #1291 (c855f1c) into main (868709e) will decrease coverage by 0.02%.
The diff coverage is 0.00%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1291      +/-   ##
==========================================
- Coverage   43.92%   43.90%   -0.03%     
==========================================
  Files          49       49              
  Lines        5514     5517       +3     
==========================================
  Hits         2422     2422              
- Misses       2972     2975       +3     
  Partials      120      120              

[jhrozek]

It would be nice to document the new options. I'm on the fence about a test, ideally we should have everything tested (and e.g. we do have tests for webhook label changes), but the patch "just" adds a public kube type, so..shrug.

By the way, thanks a lot for doing this performance and scalability work!

[pjbgf]

A few small nits, but overall lgtm from me. Thank you for working on this @ccojocar.

[ccojocar]

It would be nice to document the new options. I'm on the fence about a test, ideally we should have everything tested (and e.g. we do have tests for webhook label changes), but the patch "just" adds a public kube type, so..shrug.

I'll add some docs and tests.

[ccojocar]

@jhrozek @pjbgf I think that I addressed all your remarks. I added some documentation and an e2e test.

[ccojocar]

/test all

[ccojocar]

@saschagrunert it seems that this one passed. It just requires a review. Please could you have a look? Thanks

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ccojocar, saschagrunert

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [saschagrunert]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment