This was being silently ignored until this commit e2bf91452a s3: report errors on bucket creation (mkdir) correctly
e2bf91452a