Are Justin Bieber and Hailey Baldwin getting ready to head down the aisle?

That's what it looks like, as the two were spotted at the Marriage Bureau in New York City, where marriage licenses are issued. A source tells ET that Bieber and Baldwin are not married.

A photo obtained by TMZ shows the couple heading into the building on Thursday, where eyewitnesses told the outlet Bieber was crying and said to his fiancée, "I can't wait to marry you, baby."

Justin Bieber Hangs With Hailey Baldwin's Dad Stephen -- Pics!

In New York, marriage licenses are valid beginning 24 hours after it's issued, and until 60 calendar days from that date. That means if Bieber and Baldwin did indeed obtain a marriage license, they could tie the knot anytime between Friday and Nov. 13.

However, the 24-hour waiting period can be waived by a judge or justice of the Supreme Court of New York State or the county judge of the county in which either Baldwin or Bieber resides.

Kendall Jenner Gets Candid About Hailey Baldwin and Justin Bieber’s Engagement

A source told ET last month that Bieber, 24, and Baldwin, 21, were in no rush to get married after he popped the question on July 7.

“The couple have talked to a lot of people close to them, and are listening to the constant advice they’ve been receiving to ‘enjoy the ride,’" the source explained. "[They are] in a loving relationship and are working on the foundation now to maintain the forever."

Justin Bieber and Hailey Baldwin's Sizzling Summer: Everything We Know and What's Next

Bieber was snapped spending some time with his fiancee's father, Stephen Baldwin, on Monday, just after the model made it clear she wasn't letting anything take her off cloud nine.

"I’m beyond excited,” she told the Daily Telegraph’s Stellar magazine of her upcoming wedding. “I don’t think it’s affected me really. I have learnt to just try my best to ignore the negativity at this time so that I can enjoy this season of my life.”

ET has reached out to Bieber and Baldwin's reps for comment.