Calculate date based on provided week and day number

I want to retrieve date by providing week number and day.

E.g

Week: 1
Day: 6

This should provide me:

2023-01-05

And if I provide past day:

E.g:

Week: 1
Day: 2

This should get me next month’s date:

2023-02-02

What I have tried so far is:

var day = 6;
var date = new Date();
const dayAtDate = date.getDay()
let dayDiff = day - dayAtDate
if(dayDiff <= 0)
dayDiff = 7+dayDiff
const desiredDate = date.setDate(date.getDate() + dayDiff)
console.log(new Date(desiredDate))

But this is providing me the wrong result here.

Can anyone help me with the best possible solution for this?