How To Run A Local AI Chatbot On Your iPhone



For a lot of people, the most appealing reason to use a local chatbot will be the amount of money you can save. Right now, running a local model on your iPhone involves, at most, a one-time purchase of $5.

Compare that to a subscription from any of the big AI labs. For instance, if you want to use ChatGPT without ads, you’ll need to spend at least $20 per month on OpenAI’s Plus plan. You could get away with the more affordable Go tier or even stick with the free offering if you plan to use ChatGPT only sporadically, but then you also need to consider rate limits. Similarly, Google AI plans start at $8 per month, but you could spend as much $100 every month on its Ultra subscription. When you run an AI chatbot off your iPhone, you can use it as much as you want. As a power user, you’re very likely to hit your daily usage limit with ChatGPT, Claude or Gemini if you don’t pony up.

For the privacy-minded, local chatbots offer another advantage. None of the options I’ll be recommending in this article require a login or for you to share your data with the labs that trained the models you want to run. The app developers also say they don’t collect any usage information. With proprietary models, you should assume your prompts, and any information, images, audio or video you share will be used to train future models. There are rare exceptions. Proton’s Lumo chatbot, for example, is fully private by default. For most chatbots, including ChatGPT, you’ll need to do some digging to opt out of sharing your data for model training.

Something you also can’t do with ChatGPT, Claude or Gemini is use them without an internet connection, whereas local chatbots can run even if you’re offline.

That said, there are a few drawbacks worth noting. As capable as the latest open-weight models are, they’re not as sophisticated as the latest proprietary models from Anthropic, OpenAI and other for-profit AI labs. For instance, closed models, due to the powerful cloud hardware powering them, tend to offer longer context windows that allow them to reference information from past chats. In practice, that translates to chatbots that feel more intelligent and conversational, since you won’t need to repeat yourself often, if ever.

What’s more, both ChatGPT and Claude offer robust “memory” features that allow them to personalize their responses to each user. My version of ChatGPT knows my main axe is a 1993 Fender Stratocaster, and will frequently reference that fact when I ask it guitar-related questions. For some people, this is something that can make using a chatbot addictive, since it feels like the system wants to know them.

If you need a chatbot that can provide timely information, a local model probably won’t cut it. All LLMs have a knowledge cutoff. That’s the point in time beyond which their training data doesn’t cover. In the case of GPT-5.5 Instant, for example, it won’t be able to reference events past August 2024. For Llama 3.2, meanwhile, that date is December 2023.

To answer questions beyond its knowledge cutoff, a model will ideally turn to a robust web search tool. Proprietary models offer two advantages as it relates to timeliness. First, the current pace at which companies like OpenAI are releasing new models means those systems inherently incorporate more recent data since they’re newer. Moreover, since you need an internet connection to use ChatGPT, Claude or Gemini, those chatbots can easily search the web to augment their answers. Open source models can use web search tools, but not without third-party extensions.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


Architects and engineers who design energy-efficient government buildings can qualify for a Section 179D tax deduction. Technically, it is the building owner who qualifies, but since the government is the owner of the building and does not pay tax, our tax law allows the allocation of the deduction to the designer. This allocation provides an incentive for designers to take on government building projects.

This allocation raises some interesting questions, such as what year the allocated deduction is available. Designers often work on multiple buildings for the same client or project, and the work typically spans several years. So can the designer simply claim the tax deduction on their current year return–perhaps in the year that the final building for the project is completed? The court in Cannon Corp. v. Commissioner, No. 23-XXX (2d Cir. Feb. 18, 2025), recently answered this question.

Facts & Procedural History

The taxpayer in this case designed energy-efficient buildings for government clients between 2006 and 2011. As the designer, was allocated the Section 179D tax deductions that would normally go to the government building owners. After successfully claiming these deductions on an amended return for 2006, the taxpayer failed to claim approximately $3.9 million in Section 179D deductions for buildings placed in service from 2007 through 2010 on its originally-filed income tax returns.

Instead of filing separate amended tax returns for each year, the taxpayer reported all of the deductions at once on its 2011 tax return. It did this by reporting the deduction as an accounting method change on a Form 3115. The IRS audited the tax return and issued a notice of deficiency denying the Section 179D deductions. The taxpayer challenged this determination in tax court, but the court granted summary judgment for the IRS. This appeal was from the tax court case.

About the Section 179D Deduction

Section 179D allows owners of commercial buildings to deduct the cost of energy efficient commercial building property. This is for property placed in service during the tax year. The amount of the tax deduction is calculated based on a formula that considers the building’s square footage and energy cost reductions.

Specifically, the deduction amount starts at $0.50 per square foot and can increase up to $1.00 per square foot based on the building’s energy efficiency. The rate increases by $0.02 for each percentage point by which the building’s total annual energy and power costs are certified to be reduced by more than 25 percent. For certain qualifying properties, these base amounts can be increased to $2.50 per square foot (up to $5.00 per square foot) if prevailing wage and apprenticeship requirements are met.

The energy efficient improvements must be to one or more of three specific building systems:

  • Interior lighting systems
  • Heating, cooling, ventilation, and hot water systems
  • Building envelope

These improvements must be certified as part of a plan designed to reduce the building’s total annual energy and power costs by 25% or more compared to a reference building that meets minimum efficiency standards. The certification must be performed by qualified individuals using approved software.

As noted above

As noted above, there is an allocation rule that can apply to government-owned buildings. Since government entities cannot use tax deductions, they can allocate the deduction to the person primarily responsible for designing the property. This allocation makes the designer “the taxpayer” for purposes of claiming the Section 179D deduction. Eligible government entities include federal, state, and local governments, their agencies and instrumentalities, Indian tribal governments, and other tax-exempt organizations.

One challenge presented by this Section 179D allocation i…

One challenge presented by this Section 179D allocation is determining who qualifies as the “designer” of the energy-efficient commercial building property. Only the designer is eligible to claim the deduction when the property is owned by a government entity. The courts addressed this in United States v. Oehler, 9 F.3d 1538 (2d Cir. 1993), for a designer who installed and identified additional fixtures for replacement, but did not create the technical specifications for the lighting systems.

The architects and engineers retained provided the designs, and the taxpayer’s role was limited to implementation. Because the taxpayer merely installed the systems rather than designing them, the court held that it was not entitled to the deduction as they were not the designer for purposes of this tax deduction.

When to Report Section 179D Deductions?

Another aspect of this allocation that is challenging is that the designers do not control when the property is placed in service–the government entity does. While designers may complete their work well before the building systems are operational, IRS Notice 2008-40 states that designers may only claim the deduction in the tax year that the government places the property in service.

This timing rule creates practical challenges. Designers may not know exactly when the government places the property in service. Even when they do know the placed-in-service date, they might not learn about their ability to claim the Section 179D deduction until after they have filed their tax return for that year. This raises the question of how to claim the deduction for prior tax years.

One approach taxpayers have tried is to treat missed Section 179D deductions as an accounting method change. A change in accounting method typically involves changing when an item of income or deduction is reported – essentially shifting the timing between tax years. Under Section 481 of the tax code and its regulations, a material item qualifies for accounting method change treatment only if it involves the proper time for including an item in income or claiming a deduction.

Section 179D Deduction for a Prior Year a Method Change?

One might think that taking a Section 179D deduction for a prior year is an accounting method change. An accounting method change typically involves changing when an item of income or deduction is reported–essentially shifting the timing between tax years. Under Section 481 of the tax code and its regulations, a material item qualifies for accounting method change treatment only if it involves the proper time for including an item in income or claiming a deduction.

However, the regulations clarify that an accounting method change cannot permanently alter a taxpayer’s lifetime income. Instead, it must merely affect the timing of when income or deductions are reported. For example, changing from the cash to accrual method shifts when income and expenses are recognized but does not permanently change the total amount reported over time.

This brings us to the court case. The Second Circuit agreed with the tax court that Section 179D deductions do not qualify as an accounting method change. The court noted that these deductions permanently reduced the taxpayer’s taxable income rather than merely shifting the timing of deductions between years. This is due to the Section 179D deduction. Unlike building owners who might accelerate depreciation deductions, designers receive a one-time allocated deduction that permanently reduces their tax liability.

The Second Circuit also found that Revenue Procedure 2011-14

The Second Circuit also found that Revenue Procedure 2011-14, which the taxpayer cited, did not authorize designers to use the accounting method change procedures. While this guidance included some filing instructions for designers, it never explicitly permitted them to report prior year Section 179D deductions as accounting method changes.

The Role of Amended Returns and Statutes of Limitations

The designers do have a few ways to deal with this situation. As noted in this case, the proper procedure for claiming missed Section 179D deductions is to file amended returns for the specific tax years when the buildings were placed in service. The time for filing an amended return is limited by the general three-year statute of limitations for filing amended returns under Section 6511.

It was this timing limitation that prevented the taxpayer in this case from filing an amended return for 2007. The statute of limitations had expired. However, the taxpayer did file “protective” amended returns for the 2008-2010 tax years that were filed within the limitations period. While the court did not directly address these amended returns, they likely preserved the taxpayer’s ability to claim deductions for these years. This is the way that designers can proactively report these deductions when they are not certain as to whether they will be allocated the tax deductions and in what year the property will be placed in service.

The Takeaway

This case shows that Section 179D tax deductions allocated to designers must be claimed in the tax year when the energy-efficient property is placed in service. These deductions cannot be claimed in later years through accounting method changes because they permanently affect taxable income rather than merely shifting the timing of deductions between years. Designers who may qualify for this deduction should consider filing protective claims with the IRS in the years that the properties could have been placed in service. This can help preserve the deductions if the property is placed in service in one year, but the allocation is not made until a later year.

Watch Our Free On-Demand Webinar

In 40 minutes, we’ll teach you how to survive an IRS audit.

We’ll explain how the IRS conducts audits and how to manage and close the audit.  



Source link