Separately boil the potatoes and asparagus until just tender. Drain well, then cool to room temperature. Place in a bowl, toss with remaining ingredients, and serve.
If making ahead, store in the fridge until needed, adding a little more oil and lemon juice if needed.