Problems with filtering table by last date

I have a table like this that I want to filter to only show the score for each user's last date and for each competency:

 

I created a LastDate measure:

LastDate = MAX(Table1[Date])

When I added User, Competency and LastDate to a table visual, it looks fine. I see the correct rows.



However, as soon as I added Score to the same visual, all the other dates appeared:



The result that I'm looking for is:



I then want to use that to calculate the average score for each competency across all users (e.g. for competency A that would be 44) and the average score for each user across all competencies (e.g. for Eric that would be 45).

Any help would be greatly appreciated. Thank you in advance.