Dozens of people who live in the border towns of Stanstead, Quebec and Derby Line, Vermont joined in protest Saturday against U.S. border officials.

For generations, the two towns have lived peacefully side-by-side.

The border between Canada and the United States runs through the middle of the community, and right through the library and opera house.

Ever since 9/11, security officials have taken a dim view of residents who cross the border willy-nilly without immediately reporting to the border patrol office.

The situation has become even more serious in recent weeks, with one long-time Derby Line resident fined $500 for crossing the street to get a slice of pizza.

Roland Roy, aka "Buzz," runs the pharmacy, and he failed to check in with Immigration before crossing the street to get lunch.

On Saturday, residents from both towns marched to -- but did not cross -- the border to show their displeasure.

One protester on the American side expressed his displeasure, saying "we apologize for some of the indignities we've been hearing about. They're really not the way we'd like our country to be represented."

Prime Minister Stephen Harper has been made aware of the issue, and says that he has been talking to the Obama administration.

"I've said repeatedly that, you know, Canada and the United States are partners when it comes to the management of our border," said Harper. "I think we have to keep making the point to our American friends that it's essential that our borders be bridges between us and not barriers."