I love smoke and always use it when I'm by myself. But it does cause a lingering smell in the basement. Luckily I will have an exhaust system to counteract that when I get the permanent layout built. I would turn it off without a question for anybody who was bothered by it though.
This is likely a dosage problem. It's infrequently inhaled so it's not an issue. I'm sure huffing it all day every day would cause issues.
Fun fact, I'm apparently still new enough that I haven't seen this topic come up before.
