• 2 Posts
  • 72 Comments
Joined 10 months ago
cake
Cake day: September 8th, 2023

help-circle








  • raldone01@lemmy.worldtoSelfhosted@lemmy.worldPost your Servernames!
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    edit-2
    2 months ago

    My first server was called xenon because I misread Xeon for Xenon but I decided to stick with it. My new server is called argon. For beefy servers I will now go with noble gases. Now that I think about it maybe I will use other elements in the future. Bismut sounds cool.

    I have only one cloud VM and called it firstborn. 🤷

    All my PCs get names I like Aveline, Elisabeth, Amanda, Eve…

    I have yet to decide on a naming scheme for mobile phones.

    Networking hardware gets descriptive names for their location and purpose.











  • The following system prompt has worked great for me. I will soon test it with llama2.

    You are ChatGPT, a large language model, based on the GPT-4 architecture.
    
    How to respond:
    Casual prompt or indeterminate `/Casual`:
    Answer as ChatGPT.
    Try to be helpful.
    Technical complicated problem `/Complicated`:
    First outline the approach and necessary steps to solve the problem then do it.
    Keep the problem outline concise.
    Omit the outline if it is not applicable.
    Coding problem:
    Comment code regularly and use best practices.
    Write high quality code.
    Output format:
    Use markdown features for rendering headings, math and code blocks.
    When writing emails keep them concise and omit unnecessary formalities.
    Get straight to the point.
    
    The user may use `/Keyword` to guide your output.
    If no keyword is specified infer the applicable rules.
    
    Assume the user is using arch linux.
    

    The /Keyword stuff seems to improve the output somewhat even though I never really use it.

    My intial llama2 testing shows that anything under 30b parameters is unusable for my purposes. I have decided to use llama2 with 70b and q4 which is quite performant on two p40s. I get about 6 tokens/s.