TopN filter and joins

We have a table with a code value and a numeric field.

I can successfully create a TopN Filtered Bar chart on this.

However, if I switch the code value field for a description for the code value that is stored in a different table the visualization fails with "Visual has exceeded the available resources". Remove the filter and it displays just fine.

Any ideas?

Failure message