Carlo Ancelotti's side were held to a goalless draw at Aston Villa on Saturday after losing at Manchester City in their previous match away from Stamford Bridge.
But they still hold a five-point advantage over Manchester United after their shock 2-2 draw with West Brom at Old Trafford.
Chelsea skipper Terry said: "People can say we are wobbling away from home but we are top of the table at the moment so let people say what they want to say.
"We've had a great start to the season and we aim to continue that. We've got a couple of home games coming up but our away form is not a problem."
Chelsea have now only won once at Villa Park in their last 12 league visits.
Terry admitted: "From our perspective, we've found it difficult coming to Villa the last three or four years.
"We knew the Manchester United result before the game started but coming to Villa is always tough.
"They've got a new manager (Gerard Houllier) and the players are trying to impress him.
"For us, to come away with a point was promising."
Terry added: "We've seen teams improve year after year in the Premier League - and Aston Villa are no different.
"Whether you go to take on a bottom side or a top side, it is going to be very difficult."
Terry returned to action at Villa Park after missing England's goalless draw with Montenegro in mid-week in a Euro 2012 qualifier with a back problem.
He is optimistic of having suffered no reaction and being fit for Tuesday's Champions League encounter away to Spartak Moscow.
Terry said: "The back is okay. I was very disappointed to miss the England game in the week.
"Sitting at home and watching the game - and the result - was really frustrating.
"But I'm fine so hopefully it (the back) will be okay for Tuesday."
Terry had accused Villa of running out of Steam in the final stages of matches last season after a 7-1 victory over the midlands club at Stamford Bridge.
Houllier believes his players are slowly but surely reaching the fitness levels he demands for the passing game he is looking to implement.
He said: "We are getting there. I think we are getting nearer the 90 minutes (fitness).
"It will take time but we will get there. Proof of that can be seen in Stiliyan Petrov.
"In the previous two games I had to take him off because he was not finishing his game in the right way, physically I mean.
"I know some people are maybe moaning but training is not to pass time, training is to improve, to practice to win.
"You saw the physical level of Chelsea. We had to compete with that."
Houllier admitted: "I still think we need to be more confident with passing and the movement.
"But that is the way I like the team to play. Ball possession doesn't mean you stand still.
"It means you have to run more than the others in between the spaces and so on.
"We are aware of that. That is why we need to be extremely fit."
Source: Team Talk
Source: Team Talk