Aside from the verses and Hadiths regarding violence which explicitly include the context of self-defence, there is definitely a portion of scripture which does not include such conditions, at least not explicitly. In other words, scripture that calls for violence against non-Muslims without explicitly mentioning it be done only for protection against harm.
The present Hadiths and Qur'an 9:29 are significant in this regard. From what I've seen, there are three major interpretations for scripture pertaining to this subject matter.
1. The idea that such scripture, like the rest of violence pertaining verses and Hadiths, also refers only to self-defence, it's just not explicitly mentioned. For example, Qur'an 9:29 is
argued to have come at a time of warfare between Muslims and Christians.
2. That Qur'an 9:29 referring to people of the Book, and Prophet's commands to destroy idol temples in Arabia are relevant to all humanity for all time. If I understood correctly, Ibn Taymiyyah argued along those lines, such as in Al Sarim-Ul-Maslool, and I have seen Wahabism argue, according to their interpretation, for the Islamic obligation to
destroy all idols wherever they may exist.
3. That such scripture is relevant to only the Arabs or the people in surrounding areas, who were directly reached by Prophet Muhammad's teachings. The argument being, that since Prophet Muhammad had a direct link with God, therefore the Prophet would have been able to resolve any suspicion against Islam that a sceptical person might have had, and even provide miracles if need be. Since there would have been no reason or excuse to deny God when a Prophet is present among the people, no one had the right to deny Islam; and those who did so, deserved punishment. This punishment, during the previous Prophets' and Biblical times, was served directly by God while during Prophet Muhammad's times was served by Muslims. This punishment is what, Qur'an 9:29 and the destruction of Arab idol temples, is referring to. People to whom Prophet Muhammad's teachings did not reach or those who lived after him, are exempt from such a punishment as they
may have a legitimate excuse or unanswered question for not believing in Islam.
The narrations mentioned above might very well be referring to only the Arabs,
however, they alone are definitely not enough to convince people who believe in the second interpretation. As far as I understand, the narrations include nothing to suggest their being restricted
only to the Arabs.