using a date from a custom field inside the permalink for a Custom Post Type

I’m using a date field inside an “event” Custom Post Type. I’m using Advanced Custom Fields to create the field.

This is the structure I want:
example.com/[custom-post-type]/[category]/[ACF-date-field]/[post-name]
as in:
example.com/events/conference/2011-11-10/cool-conference-about-things

I am able to get the permalink structure in the post-form and it shows up on the site as the permalink for the event, however I when I click the link it comes up ‘page not found’.

I would just use /year/month/day, but the date that the event was posted is not what I want, I want the date the event occurs on – which is this custom field.

thanks for any help,
Scott