How-to: Installing AI to L5 and running it locally offline with ollama.ai

Here are multiple sequential questions using ‘verbose’ mode with llama2-uncensored:

>>> /set verbose
Set 'verbose' mode.
>>> What are the controversies surrounding Purism SPC?
The main controversy around Purism SPC is that it is a closed-source 
operating system, which means that only certain people can access the 
source code. This has led to concerns over privacy and security, as well 
as questions about transparency in the development process. Additionally, 
some critics argue that the company's focus on data protection and 
security comes at the expense of user experience and innovation. However, 
supporters of Purism SPC believe that its closed-source approach allows 
for more secure and private software development.

total duration:       1m27.204596687s
load duration:        1.502986ms
prompt eval count:    33 token(s)
prompt eval duration: 13.325142s
prompt eval rate:     2.48 tokens/s
eval count:           111 token(s)
eval duration:        1m13.874077s
eval rate:            1.50 tokens/s
>>> What are the controversies surrounding Purism?
Purism has been involved in several controversies over the years, 
including their stance on surveillance, privacy, and encryption. One of 
the most notable controversies was when the company refused to cooperate 
with government agencies during the investigation into the WikiLeaks 
website. This led to accusations that Purism was engaging in political 
activism rather than being a technology company focused solely on creating
innovative products. Additionally, some have criticized Purism for its 
lack of diversity and inclusion efforts within their company.

total duration:       1m23.139962614s
load duration:        950.141µs
prompt eval count:    29 token(s)
prompt eval duration: 11.063985s
prompt eval rate:     2.62 tokens/s
eval count:           112 token(s)
eval duration:        1m12.071648s
eval rate:            1.55 tokens/s
>>> What are the controversies surrounding myGovID?
MyGovID has been involved in several controversies, including its use as a
centralized identity verification platform by governments around the 
world. Some critics argue that this approach violates privacy rights and 
could lead to surveillance of individuals without their knowledge or 
consent. Additionally, there have been concerns raised about how myGovID 
handles user data and whether it is secure enough to protect personal 
information from hacking and other cyber threats. Finally, some have 
criticized the company for its lack of transparency in terms of how the 
platform works and what exactly happens when users submit their identity 
information through the site.

total duration:       1m47.506579377s
load duration:        1.606476ms
prompt eval count:    31 token(s)
prompt eval duration: 12.647663s
prompt eval rate:     2.45 tokens/s
eval count:           129 token(s)
eval duration:        1m34.847361s
eval rate:            1.36 tokens/s
>>> What are the controversies surrounding the Competition Bureau?
The Competition Bureau has been involved in several controversies over the
years, including its handling of antitrust cases involving large 
corporations and the impact that such actions have on consumers. Some 
critics argue that the bureau is too lenient with big businesses and does 
not do enough to protect consumer interests. Additionally, there have been
concerns raised about how the Competition Bureau handles confidential 
information and whether it has the resources necessary to effectively 
investigate and prosecute cases of antitrust violations.

total duration:       1m42.034195413s
load duration:        1.234664ms
prompt eval count:    31 token(s)
prompt eval duration: 17.455753s
prompt eval rate:     1.78 tokens/s
eval count:           103 token(s)
eval duration:        1m24.56909s
eval rate:            1.22 tokens/s

The VPS Elite only has 8 GB of RAM; see this thread below for a reminder of the details:

https://forums.puri.sm/t/vps-usage-suggestions/21788 (tust level 0 and up)

1 Like